[ { "path": ".claude/commands/release/generate-release-notes.md", "content": "---\ndescription: Generate formatted release notes for Yaak releases\nallowed-tools: Bash(git tag:*)\n---\n\nGenerate formatted release notes for Yaak releases by analyzing git history and pull request descriptions.\n\n## What to do\n\n1. Identifies the version tag and previous version\n2. Retrieves all commits between versions\n - If the version is a beta version, it retrieves commits between the beta version and previous beta version\n - If the version is a stable version, it retrieves commits between the stable version and the previous stable version\n3. Fetches PR descriptions for linked issues to find:\n - Feedback URLs (feedback.yaak.app)\n - Additional context and descriptions\n - Installation links for plugins\n4. Formats the release notes using the standard Yaak format:\n - Changelog badge at the top\n - Bulleted list of changes with PR links\n - Feedback links where available\n - Full changelog comparison link at the bottom\n\n## Output Format\n\nThe skill generates markdown-formatted release notes following this structure:\n\n```markdown\n[![Changelog](https://img.shields.io/badge/Changelog-VERSION-blue)](https://yaak.app/changelog/VERSION)\n\n- Feature/fix description in by @username [#123](https://github.com/mountain-loop/yaak/pull/123)\n- [Linked feedback item](https://feedback.yaak.app/p/item) by @username in [#456](https://github.com/mountain-loop/yaak/pull/456)\n- A simple item that doesn't have a feedback or PR link\n\n**Full Changelog**: https://github.com/mountain-loop/yaak/compare/vPREV...vCURRENT\n```\n\n**IMPORTANT**: Always add a blank lines around the markdown code fence and output the markdown code block last\n**IMPORTANT**: PRs by `@gschier` should not mention the @username\n**IMPORTANT**: These are app release notes. Exclude CLI-only changes (commits prefixed with `cli:` or only touching `crates-cli/`) since the CLI has its own release process.\n\n## After Generating Release Notes\n\nAfter outputting the release notes, ask the user if they would like to create a draft GitHub release with these notes. If they confirm, create the release using:\n\n```bash\ngh release create --draft --prerelease --title \"Release \" --notes ''\n```\n\n**IMPORTANT**: The release title format is \"Release XXXX\" where XXXX is the version WITHOUT the `v` prefix. For example, tag `v2026.2.1-beta.1` gets title \"Release 2026.2.1-beta.1\".\n" }, { "path": ".claude/rules.md", "content": "# Project Rules\n\n## General Development\n\n- **NEVER** commit or push without explicit confirmation\n\n## Build and Lint\n\n- **ALWAYS** run `npm run lint` after modifying TypeScript or JavaScript files\n- Run `npm run bootstrap` after changing plugin runtime or MCP server code\n\n## Plugin System\n\n### Backend Constraints\n\n- Always use `UpdateSource::Plugin` when calling database methods from plugin events\n- Never send timestamps (`createdAt`, `updatedAt`) from TypeScript - Rust backend controls these\n- Backend uses `NaiveDateTime` (no timezone) so avoid sending ISO timestamp strings\n\n### MCP Server\n\n- MCP server has **no active window context** - cannot call `window.workspaceId()`\n- Get workspace ID from `workspaceCtx.yaak.workspace.list()` instead\n\n## Rust Type Generation\n\n- Run `cargo test --package yaak-plugins` (and for other crates) to regenerate TypeScript bindings after modifying Rust event types\n" }, { "path": ".claude-context.md", "content": "# Claude Context: Detaching Tauri from Yaak\n\n## Goal\n\nMake Yaak runnable as a standalone CLI without Tauri as a dependency. The core Rust crates in `crates/` should be usable independently, while Tauri-specific code lives in `crates-tauri/`.\n\n## Project Structure\n\n```\ncrates/ # Core crates - should NOT depend on Tauri\ncrates-tauri/ # Tauri-specific crates (yaak-app, yaak-tauri-utils, etc.)\ncrates-cli/ # CLI crate (yaak-cli)\n```\n\n## Completed Work\n\n### 1. Folder Restructure\n\n- Moved Tauri-dependent app code to `crates-tauri/yaak-app/`\n- Created `crates-tauri/yaak-tauri-utils/` for shared Tauri utilities (window traits, api_client, error handling)\n- Created `crates-cli/yaak-cli/` for the standalone CLI\n\n### 2. Decoupled Crates (no longer depend on Tauri)\n\n- **yaak-models**: Uses `init_standalone()` pattern for CLI database access\n- **yaak-http**: Removed Tauri plugin, HttpConnectionManager initialized in yaak-app setup\n- **yaak-common**: Only contains Tauri-free utilities (serde, platform)\n- **yaak-crypto**: Removed Tauri plugin, EncryptionManager initialized in yaak-app setup, commands moved to yaak-app\n- **yaak-grpc**: Replaced AppHandle with GrpcConfig struct, uses tokio::process::Command instead of Tauri sidecar\n\n### 3. CLI Implementation\n\n- Basic CLI at `crates-cli/yaak-cli/src/main.rs`\n- Commands: workspaces, requests, send (by ID), get (ad-hoc URL), create\n- Uses same database as Tauri app via `yaak_models::init_standalone()`\n\n## Remaining Work\n\n### Crates Still Depending on Tauri (in `crates/`)\n\n1. **yaak-git** (3 files) - Moderate complexity\n2. **yaak-plugins** (13 files) - **Hardest** - deeply integrated with Tauri for plugin-to-window communication\n3. **yaak-sync** (4 files) - Moderate complexity\n4. **yaak-ws** (5 files) - Moderate complexity\n\n### Pattern for Decoupling\n\n1. Remove Tauri plugin `init()` function from the crate\n2. Move commands to `yaak-app/src/commands.rs` or keep inline in `lib.rs`\n3. Move extension traits (e.g., `SomethingManagerExt`) to yaak-app or yaak-tauri-utils\n4. Initialize managers in yaak-app's `.setup()` block\n5. Remove `tauri` from Cargo.toml dependencies\n6. Update `crates-tauri/yaak-app/capabilities/default.json` to remove the plugin permission\n7. Replace `tauri::async_runtime::block_on` with `tokio::runtime::Handle::current().block_on()`\n\n## Key Files\n\n- `crates-tauri/yaak-app/src/lib.rs` - Main Tauri app, setup block initializes managers\n- `crates-tauri/yaak-app/src/commands.rs` - Migrated Tauri commands\n- `crates-tauri/yaak-app/src/models_ext.rs` - Database plugin and extension traits\n- `crates-tauri/yaak-tauri-utils/src/window.rs` - WorkspaceWindowTrait for window state\n- `crates/yaak-models/src/lib.rs` - Contains `init_standalone()` for CLI usage\n\n## Git Branch\n\nWorking on `detach-tauri` branch.\n\n## Recent Commits\n\n```\nc40cff40 Remove Tauri dependencies from yaak-crypto and yaak-grpc\ndf495f1d Move Tauri utilities from yaak-common to yaak-tauri-utils\n481e0273 Remove Tauri dependencies from yaak-http and yaak-common\n10568ac3 Add HTTP request sending to yaak-cli\nbcb7d600 Add yaak-cli stub with basic database access\ne718a5f1 Refactor models_ext to use init_standalone from yaak-models\n```\n\n## Testing\n\n- Run `cargo check -p ` to verify a crate builds without Tauri\n- Run `npm run app-dev` to test the Tauri app still works\n- Run `cargo run -p yaak-cli -- --help` to test the CLI\n" }, { "path": ".codex/skills/release-generate-release-notes/SKILL.md", "content": "---\nname: release-generate-release-notes\ndescription: Generate Yaak release notes from git history and PR metadata, including feedback links and full changelog compare links. Use when asked to run or replace the old Claude generate-release-notes command.\n---\n\n# Generate Release Notes\n\nGenerate formatted markdown release notes for a Yaak tag.\n\n## Workflow\n\n1. Determine target tag.\n2. Determine previous comparable tag:\n - Beta tag: compare against previous beta (if the root version is the same) or stable tag.\n - Stable tag: compare against previous stable tag.\n3. Collect commits in range:\n - `git log --oneline ..`\n4. For linked PRs, fetch metadata:\n - `gh pr view --json number,title,body,author,url`\n5. Extract useful details:\n - Feedback URLs (`feedback.yaak.app`)\n - Plugin install links or other notable context\n6. Format notes using Yaak style:\n - Changelog badge at top\n - Bulleted items with PR links where available\n - Feedback links where available\n - Full changelog compare link at bottom\n\n## Formatting Rules\n\n- Wrap final notes in a markdown code fence.\n- Keep a blank line before and after the code fence.\n- Output the markdown code block last.\n- Do not append `by @gschier` for PRs authored by `@gschier`.\n- These are app release notes. Exclude CLI-only changes (commits prefixed with `cli:` or only touching `crates-cli/`) since the CLI has its own release process.\n\n## Release Creation Prompt\n\nAfter producing notes, ask whether to create a draft GitHub release.\n\nIf confirmed and release does not yet exist, run:\n\n`gh release create --draft --prerelease --title \"Release \" --notes ''`\n\nIf a draft release for the tag already exists, update it instead:\n\n`gh release edit --title \"Release \" --notes-file `\n\nUse title format `Release `, e.g. `v2026.2.1-beta.1` -> `Release 2026.2.1-beta.1`.\n" }, { "path": ".gitattributes", "content": "crates-tauri/yaak-app/vendored/**/* linguist-generated=true\ncrates-tauri/yaak-app/gen/schemas/**/* linguist-generated=true\n**/bindings/* linguist-generated=true\ncrates/yaak-templates/pkg/* linguist-generated=true\n\n# Ensure consistent line endings for test files that check exact content\ncrates/yaak-http/tests/test.txt text eol=lf\n" }, { "path": ".github/FUNDING.yml", "content": "# These are supported funding model platforms\n\ngithub: gschier\n" }, { "path": ".github/ISSUE_TEMPLATE/bug_report.md", "content": "---\nname: Bug report\nabout: Create a report to help us improve\ntitle: \"\"\nlabels: \"\"\nassignees: \"\"\n---\n\n**Describe the bug**\nA clear and concise description of what the bug is.\n\n**To Reproduce**\nSteps to reproduce the behavior:\n\n1. Go to '...'\n2. Click on '....'\n3. Scroll down to '....'\n4. See error\n\n**Expected behavior**\nA clear and concise description of what you expected to happen.\n\n**Screenshots**\nIf applicable, add screenshots to help explain your problem.\n\n**Desktop (please complete the following information):**\n\n- OS: [e.g. iOS]\n- Browser [e.g. chrome, safari]\n- Version [e.g. 22]\n\n**Smartphone (please complete the following information):**\n\n- Device: [e.g. iPhone6]\n- OS: [e.g. iOS8.1]\n- Browser [e.g. stock browser, safari]\n- Version [e.g. 22]\n\n**Additional context**\nAdd any other context about the problem here.\n" }, { "path": ".github/ISSUE_TEMPLATE/config.yml", "content": "blank_issues_enabled: false\ncontact_links:\n - name: Bugs, Feedback, Feature Requests, and Questions\n url: https://feedback.yaak.app\n about: \"Please report to Yaak's public feedback board. Issues will be created and linked here when applicable.\"\n" }, { "path": ".github/pull_request_template.md", "content": "## Summary\n\n\n\n## Submission\n\n- [ ] This PR is a bug fix or small-scope improvement.\n- [ ] If this PR is not a bug fix or small-scope improvement, I linked an approved feedback item below.\n- [ ] I have read and followed [`CONTRIBUTING.md`](CONTRIBUTING.md).\n- [ ] I tested this change locally.\n- [ ] I added or updated tests when reasonable.\n\nApproved feedback item (required if not a bug fix or small-scope improvement):\n\n\n\n## Related\n\n\n" }, { "path": ".github/workflows/ci.yml", "content": "on:\n pull_request:\n push:\n branches:\n - main\n\nname: Lint and Test\npermissions:\n contents: read\n\njobs:\n test:\n name: Lint/Test\n runs-on: macos-latest\n steps:\n - uses: actions/checkout@v4\n - uses: voidzero-dev/setup-vp@v1\n with:\n node-version: \"24\"\n cache: true\n - uses: dtolnay/rust-toolchain@stable\n - uses: Swatinem/rust-cache@v2\n with:\n shared-key: ci\n cache-on-failure: true\n\n - run: vp install\n - run: npm run bootstrap\n - run: npm run lint\n - name: Run JS Tests\n run: vp test\n - name: Run Rust Tests\n run: cargo test --all\n" }, { "path": ".github/workflows/claude.yml", "content": "name: Claude Code\n\non:\n issue_comment:\n types: [created]\n pull_request_review_comment:\n types: [created]\n issues:\n types: [opened, assigned]\n pull_request_review:\n types: [submitted]\n\njobs:\n claude:\n if: |\n (github.event_name == 'issue_comment' && contains(github.event.comment.body, '@claude')) ||\n (github.event_name == 'pull_request_review_comment' && contains(github.event.comment.body, '@claude')) ||\n (github.event_name == 'pull_request_review' && contains(github.event.review.body, '@claude')) ||\n (github.event_name == 'issues' && (contains(github.event.issue.body, '@claude') || contains(github.event.issue.title, '@claude')))\n runs-on: ubuntu-latest\n permissions:\n contents: read\n pull-requests: read\n issues: read\n id-token: write\n actions: read # Required for Claude to read CI results on PRs\n steps:\n - name: Checkout repository\n uses: actions/checkout@v4\n with:\n fetch-depth: 1\n\n - name: Run Claude Code\n id: claude\n uses: anthropics/claude-code-action@v1\n with:\n claude_code_oauth_token: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}\n\n # This is an optional setting that allows Claude to read CI results on PRs\n additional_permissions: |\n actions: read\n\n # Optional: Give a custom prompt to Claude. If this is not specified, Claude will perform the instructions specified in the comment that tagged it.\n # prompt: 'Update the pull request description to include a summary of changes.'\n\n # Optional: Add claude_args to customize behavior and configuration\n # See https://github.com/anthropics/claude-code-action/blob/main/docs/usage.md\n # or https://code.claude.com/docs/en/cli-reference for available options\n # claude_args: '--allowed-tools Bash(gh pr:*)'\n" }, { "path": ".github/workflows/flathub.yml", "content": "name: Update Flathub\non:\n release:\n types: [published]\n\npermissions:\n contents: read\n\njobs:\n update-flathub:\n name: Update Flathub manifest\n runs-on: ubuntu-latest\n # Only run for stable releases (skip betas/pre-releases)\n if: ${{ !github.event.release.prerelease }}\n steps:\n - name: Checkout app repo\n uses: actions/checkout@v4\n\n - name: Checkout Flathub repo\n uses: actions/checkout@v4\n with:\n repository: flathub/app.yaak.Yaak\n token: ${{ secrets.FLATHUB_TOKEN }}\n path: flathub-repo\n\n - name: Set up Python\n uses: actions/setup-python@v5\n with:\n python-version: \"3.12\"\n\n - name: Set up Node.js\n uses: actions/setup-node@v4\n with:\n node-version: \"22\"\n\n - name: Install source generators\n run: |\n pip install flatpak-node-generator tomlkit aiohttp\n git clone --depth 1 https://github.com/flatpak/flatpak-builder-tools flatpak/flatpak-builder-tools\n\n - name: Run update-manifest.sh\n run: bash flatpak/update-manifest.sh \"${{ github.event.release.tag_name }}\" flathub-repo\n\n - name: Commit and push to Flathub\n working-directory: flathub-repo\n run: |\n git config user.name \"github-actions[bot]\"\n git config user.email \"github-actions[bot]@users.noreply.github.com\"\n git add -A\n git diff --cached --quiet && echo \"No changes to commit\" && exit 0\n git commit -m \"Update to ${{ github.event.release.tag_name }}\"\n git push\n" }, { "path": ".github/workflows/release-api-npm.yml", "content": "name: Release API to NPM\n\non:\n push:\n tags: [yaak-api-*]\n workflow_dispatch:\n inputs:\n version:\n description: API version to publish (for example 0.9.0 or v0.9.0)\n required: true\n type: string\n\npermissions:\n contents: read\n\njobs:\n publish-npm:\n name: Publish @yaakapp/api\n runs-on: ubuntu-latest\n permissions:\n contents: read\n id-token: write\n\n steps:\n - name: Checkout\n uses: actions/checkout@v4\n\n - name: Setup Node\n uses: actions/setup-node@v4\n with:\n node-version: lts/*\n registry-url: https://registry.npmjs.org\n\n - name: Install dependencies\n run: npm ci\n\n - name: Set @yaakapp/api version\n shell: bash\n env:\n WORKFLOW_VERSION: ${{ inputs.version }}\n run: |\n set -euo pipefail\n if [ \"${{ github.event_name }}\" = \"workflow_dispatch\" ]; then\n VERSION=\"$WORKFLOW_VERSION\"\n else\n VERSION=\"${GITHUB_REF_NAME#yaak-api-}\"\n fi\n VERSION=\"${VERSION#v}\"\n echo \"Preparing @yaakapp/api version: $VERSION\"\n cd packages/plugin-runtime-types\n npm version \"$VERSION\" --no-git-tag-version --allow-same-version\n\n - name: Build @yaakapp/api\n working-directory: packages/plugin-runtime-types\n run: npm run build\n\n - name: Publish @yaakapp/api\n working-directory: packages/plugin-runtime-types\n run: npm publish --provenance --access public\n" }, { "path": ".github/workflows/release-app.yml", "content": "name: Release App Artifacts\non:\n push:\n tags: [v*]\n\njobs:\n build-artifacts:\n permissions:\n contents: write\n\n name: Build\n strategy:\n fail-fast: false\n matrix:\n include:\n - platform: \"macos-latest\" # for Arm-based Macs (M1 and above).\n args: \"--target aarch64-apple-darwin\"\n yaak_arch: \"arm64\"\n os: \"macos\"\n targets: \"aarch64-apple-darwin\"\n - platform: \"macos-latest\" # for Intel-based Macs.\n args: \"--target x86_64-apple-darwin\"\n yaak_arch: \"x64\"\n os: \"macos\"\n targets: \"x86_64-apple-darwin\"\n - platform: \"ubuntu-22.04\"\n args: \"\"\n yaak_arch: \"x64\"\n os: \"ubuntu\"\n targets: \"\"\n - platform: \"ubuntu-22.04-arm\"\n args: \"\"\n yaak_arch: \"arm64\"\n os: \"ubuntu\"\n targets: \"\"\n - platform: \"windows-latest\"\n args: \"\"\n yaak_arch: \"x64\"\n os: \"windows\"\n targets: \"\"\n # Windows ARM64\n - platform: \"windows-latest\"\n args: \"--target aarch64-pc-windows-msvc\"\n yaak_arch: \"arm64\"\n os: \"windows\"\n targets: \"aarch64-pc-windows-msvc\"\n runs-on: ${{ matrix.platform }}\n timeout-minutes: 40\n steps:\n - name: Checkout yaakapp/app\n uses: actions/checkout@v4\n\n - name: Setup Vite+\n uses: voidzero-dev/setup-vp@v1\n with:\n node-version: \"24\"\n cache: true\n\n - name: install Rust stable\n uses: dtolnay/rust-toolchain@stable\n with:\n targets: ${{ matrix.targets }}\n\n - uses: Swatinem/rust-cache@v2\n with:\n shared-key: ci\n cache-on-failure: true\n\n - name: install dependencies (Linux only)\n if: matrix.os == 'ubuntu'\n run: |\n sudo apt-get update\n sudo apt-get install -y libwebkit2gtk-4.1-dev libappindicator3-dev librsvg2-dev patchelf xdg-utils\n\n - name: Install Protoc for plugin-runtime\n uses: arduino/setup-protoc@v3\n with:\n repo-token: ${{ secrets.GITHUB_TOKEN }}\n\n - name: Install trusted-signing-cli (Windows only)\n if: matrix.os == 'windows'\n shell: pwsh\n run: |\n $ErrorActionPreference = 'Stop'\n $dir = \"$env:USERPROFILE\\trusted-signing\"\n New-Item -ItemType Directory -Force -Path $dir | Out-Null\n $url = \"https://github.com/Levminer/trusted-signing-cli/releases/download/0.8.0/trusted-signing-cli.exe\"\n $exe = Join-Path $dir \"trusted-signing-cli.exe\"\n Invoke-WebRequest -Uri $url -OutFile $exe\n echo $dir >> $env:GITHUB_PATH\n & $exe --version\n\n - run: vp install\n - run: npm run bootstrap\n env:\n YAAK_TARGET_ARCH: ${{ matrix.yaak_arch }}\n - run: npm run lint\n - name: Run JS Tests\n run: vp test\n - name: Run Rust Tests\n run: cargo test --all --exclude yaak-cli\n\n - name: Set version\n run: npm run replace-version\n env:\n YAAK_VERSION: ${{ github.ref_name }}\n\n - name: Sign vendored binaries (macOS only)\n if: matrix.os == 'macos'\n env:\n APPLE_CERTIFICATE: ${{ secrets.APPLE_CERTIFICATE }}\n APPLE_CERTIFICATE_PASSWORD: ${{ secrets.APPLE_CERTIFICATE_PASSWORD }}\n APPLE_SIGNING_IDENTITY: ${{ secrets.APPLE_SIGNING_IDENTITY }}\n KEYCHAIN_PASSWORD: ${{ secrets.KEYCHAIN_PASSWORD }}\n run: |\n # Create keychain\n KEYCHAIN_PATH=$RUNNER_TEMP/app-signing.keychain-db\n security create-keychain -p \"$KEYCHAIN_PASSWORD\" $KEYCHAIN_PATH\n security set-keychain-settings -lut 21600 $KEYCHAIN_PATH\n security unlock-keychain -p \"$KEYCHAIN_PASSWORD\" $KEYCHAIN_PATH\n\n # Import certificate\n echo \"$APPLE_CERTIFICATE\" | base64 --decode > certificate.p12\n security import certificate.p12 -P \"$APPLE_CERTIFICATE_PASSWORD\" -A -t cert -f pkcs12 -k $KEYCHAIN_PATH\n security list-keychain -d user -s $KEYCHAIN_PATH\n\n # Sign vendored binaries with hardened runtime and their specific entitlements\n codesign --force --options runtime --entitlements crates-tauri/yaak-app/macos/entitlements.yaakprotoc.plist --sign \"$APPLE_SIGNING_IDENTITY\" crates-tauri/yaak-app/vendored/protoc/yaakprotoc || true\n codesign --force --options runtime --entitlements crates-tauri/yaak-app/macos/entitlements.yaaknode.plist --sign \"$APPLE_SIGNING_IDENTITY\" crates-tauri/yaak-app/vendored/node/yaaknode || true\n\n - uses: tauri-apps/tauri-action@v0\n env:\n YAAK_TARGET_ARCH: ${{ matrix.yaak_arch }}\n\n ENABLE_CODE_SIGNING: ${{ secrets.APPLE_CERTIFICATE }}\n GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}\n TAURI_SIGNING_PRIVATE_KEY: ${{ secrets.TAURI_PRIVATE_KEY }}\n TAURI_SIGNING_PRIVATE_KEY_PASSWORD: ${{ secrets.TAURI_KEY_PASSWORD }}\n\n # Apple signing stuff\n APPLE_CERTIFICATE: ${{ matrix.os == 'macos' && secrets.APPLE_CERTIFICATE }}\n APPLE_CERTIFICATE_PASSWORD: ${{ matrix.os == 'macos' && secrets.APPLE_CERTIFICATE_PASSWORD }}\n APPLE_ID: ${{ matrix.os == 'macos' && secrets.APPLE_ID }}\n APPLE_PASSWORD: ${{ matrix.os == 'macos' && secrets.APPLE_PASSWORD }}\n APPLE_SIGNING_IDENTITY: ${{ matrix.os == 'macos' && secrets.APPLE_SIGNING_IDENTITY }}\n APPLE_TEAM_ID: ${{ matrix.os == 'macos' && secrets.APPLE_TEAM_ID }}\n\n # Windows signing stuff\n AZURE_CLIENT_ID: ${{ matrix.os == 'windows' && secrets.AZURE_CLIENT_ID }}\n AZURE_CLIENT_SECRET: ${{ matrix.os == 'windows' && secrets.AZURE_CLIENT_SECRET }}\n AZURE_TENANT_ID: ${{ matrix.os == 'windows' && secrets.AZURE_TENANT_ID }}\n with:\n tagName: \"v__VERSION__\"\n releaseName: \"Release __VERSION__\"\n releaseBody: \"[Changelog __VERSION__](https://yaak.app/blog/__VERSION__)\"\n releaseDraft: true\n prerelease: true\n args: \"${{ matrix.args }} --config ./crates-tauri/yaak-app/tauri.release.conf.json\"\n\n # Build a per-machine NSIS installer for enterprise deployment (PDQ, SCCM, Intune)\n - name: Build and upload machine-wide installer (Windows only)\n if: matrix.os == 'windows'\n shell: pwsh\n env:\n YAAK_TARGET_ARCH: ${{ matrix.yaak_arch }}\n GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}\n AZURE_CLIENT_ID: ${{ secrets.AZURE_CLIENT_ID }}\n AZURE_CLIENT_SECRET: ${{ secrets.AZURE_CLIENT_SECRET }}\n AZURE_TENANT_ID: ${{ secrets.AZURE_TENANT_ID }}\n TAURI_SIGNING_PRIVATE_KEY: ${{ secrets.TAURI_PRIVATE_KEY }}\n TAURI_SIGNING_PRIVATE_KEY_PASSWORD: ${{ secrets.TAURI_KEY_PASSWORD }}\n run: |\n Get-ChildItem -Recurse -Path target -File -Filter \"*.exe.sig\" | Remove-Item -Force\n npx tauri bundle ${{ matrix.args }} --bundles nsis --config ./crates-tauri/yaak-app/tauri.release.conf.json --config '{\"bundle\":{\"createUpdaterArtifacts\":true,\"windows\":{\"nsis\":{\"installMode\":\"perMachine\"}}}}'\n $setup = Get-ChildItem -Recurse -Path target -Filter \"*setup*.exe\" | Select-Object -First 1\n $setupSig = \"$($setup.FullName).sig\"\n $dest = $setup.FullName -replace '-setup\\.exe$', '-setup-machine.exe'\n $destSig = \"$dest.sig\"\n Copy-Item $setup.FullName $dest\n Copy-Item $setupSig $destSig\n gh release upload \"${{ github.ref_name }}\" \"$dest\" --clobber\n gh release upload \"${{ github.ref_name }}\" \"$destSig\" --clobber\n" }, { "path": ".github/workflows/release-cli-npm.yml", "content": "name: Release CLI to NPM\n\non:\n push:\n tags: [yaak-cli-*]\n workflow_dispatch:\n inputs:\n version:\n description: CLI version to publish (for example 0.4.0 or v0.4.0)\n required: true\n type: string\n\npermissions:\n contents: read\n\njobs:\n prepare-vendored-assets:\n name: Prepare vendored plugin assets\n runs-on: ubuntu-latest\n\n steps:\n - name: Checkout\n uses: actions/checkout@v4\n\n - name: Setup Node\n uses: actions/setup-node@v4\n with:\n node-version: lts/*\n\n - name: Install Rust stable\n uses: dtolnay/rust-toolchain@stable\n\n - name: Install dependencies\n run: npm ci\n\n - name: Build plugin assets\n env:\n SKIP_WASM_BUILD: \"1\"\n run: |\n npm run build\n npm run vendor:vendor-plugins\n\n - name: Upload vendored assets\n uses: actions/upload-artifact@v4\n with:\n name: vendored-assets\n path: |\n crates-tauri/yaak-app/vendored/plugin-runtime/index.cjs\n crates-tauri/yaak-app/vendored/plugins\n if-no-files-found: error\n\n build-binaries:\n name: Build ${{ matrix.pkg }}\n needs: prepare-vendored-assets\n runs-on: ${{ matrix.runner }}\n strategy:\n fail-fast: false\n matrix:\n include:\n - pkg: cli-darwin-arm64\n runner: macos-latest\n target: aarch64-apple-darwin\n binary: yaak\n - pkg: cli-darwin-x64\n runner: macos-latest\n target: x86_64-apple-darwin\n binary: yaak\n - pkg: cli-linux-arm64\n runner: ubuntu-22.04-arm\n target: aarch64-unknown-linux-gnu\n binary: yaak\n - pkg: cli-linux-x64\n runner: ubuntu-22.04\n target: x86_64-unknown-linux-gnu\n binary: yaak\n - pkg: cli-win32-arm64\n runner: windows-latest\n target: aarch64-pc-windows-msvc\n binary: yaak.exe\n - pkg: cli-win32-x64\n runner: windows-latest\n target: x86_64-pc-windows-msvc\n binary: yaak.exe\n\n steps:\n - name: Checkout\n uses: actions/checkout@v4\n\n - name: Install Rust stable\n uses: dtolnay/rust-toolchain@stable\n with:\n targets: ${{ matrix.target }}\n\n - name: Restore Rust cache\n uses: Swatinem/rust-cache@v2\n with:\n shared-key: release-cli-npm\n cache-on-failure: true\n\n - name: Install Linux build dependencies\n if: startsWith(matrix.runner, 'ubuntu')\n run: |\n sudo apt-get update\n sudo apt-get install -y pkg-config libdbus-1-dev\n\n - name: Download vendored assets\n uses: actions/download-artifact@v4\n with:\n name: vendored-assets\n path: crates-tauri/yaak-app/vendored\n\n - name: Set CLI build version\n shell: bash\n env:\n WORKFLOW_VERSION: ${{ inputs.version }}\n run: |\n set -euo pipefail\n if [ \"${{ github.event_name }}\" = \"workflow_dispatch\" ]; then\n VERSION=\"$WORKFLOW_VERSION\"\n else\n VERSION=\"${GITHUB_REF_NAME#yaak-cli-}\"\n fi\n VERSION=\"${VERSION#v}\"\n echo \"Building yaak version: $VERSION\"\n echo \"YAAK_CLI_VERSION=$VERSION\" >> \"$GITHUB_ENV\"\n\n - name: Build yaak\n run: cargo build --locked --release -p yaak-cli --bin yaak --target ${{ matrix.target }}\n\n - name: Stage binary artifact\n shell: bash\n run: |\n set -euo pipefail\n mkdir -p \"npm/dist/${{ matrix.pkg }}\"\n cp \"target/${{ matrix.target }}/release/${{ matrix.binary }}\" \"npm/dist/${{ matrix.pkg }}/${{ matrix.binary }}\"\n\n - name: Upload binary artifact\n uses: actions/upload-artifact@v4\n with:\n name: ${{ matrix.pkg }}\n path: npm/dist/${{ matrix.pkg }}/${{ matrix.binary }}\n if-no-files-found: error\n\n publish-npm:\n name: Publish @yaakapp/cli packages\n needs: build-binaries\n runs-on: ubuntu-latest\n permissions:\n contents: read\n id-token: write\n\n steps:\n - name: Checkout\n uses: actions/checkout@v4\n\n - name: Setup Node\n uses: actions/setup-node@v4\n with:\n node-version: lts/*\n registry-url: https://registry.npmjs.org\n\n - name: Download binary artifacts\n uses: actions/download-artifact@v4\n with:\n pattern: cli-*\n path: npm/dist\n merge-multiple: false\n\n - name: Prepare npm packages\n shell: bash\n env:\n WORKFLOW_VERSION: ${{ inputs.version }}\n run: |\n set -euo pipefail\n if [ \"${{ github.event_name }}\" = \"workflow_dispatch\" ]; then\n VERSION=\"$WORKFLOW_VERSION\"\n else\n VERSION=\"${GITHUB_REF_NAME#yaak-cli-}\"\n fi\n VERSION=\"${VERSION#v}\"\n if [[ \"$VERSION\" == *-* ]]; then\n PRERELEASE=\"${VERSION#*-}\"\n NPM_TAG=\"${PRERELEASE%%.*}\"\n else\n NPM_TAG=\"latest\"\n fi\n echo \"Preparing CLI npm packages for version: $VERSION\"\n echo \"Publishing with npm dist-tag: $NPM_TAG\"\n echo \"NPM_TAG=$NPM_TAG\" >> \"$GITHUB_ENV\"\n YAAK_CLI_VERSION=\"$VERSION\" node npm/prepare-publish.js\n\n - name: Publish @yaakapp/cli-darwin-arm64\n run: npm publish --provenance --access public --tag \"$NPM_TAG\"\n working-directory: npm/cli-darwin-arm64\n\n - name: Publish @yaakapp/cli-darwin-x64\n run: npm publish --provenance --access public --tag \"$NPM_TAG\"\n working-directory: npm/cli-darwin-x64\n\n - name: Publish @yaakapp/cli-linux-arm64\n run: npm publish --provenance --access public --tag \"$NPM_TAG\"\n working-directory: npm/cli-linux-arm64\n\n - name: Publish @yaakapp/cli-linux-x64\n run: npm publish --provenance --access public --tag \"$NPM_TAG\"\n working-directory: npm/cli-linux-x64\n\n - name: Publish @yaakapp/cli-win32-arm64\n run: npm publish --provenance --access public --tag \"$NPM_TAG\"\n working-directory: npm/cli-win32-arm64\n\n - name: Publish @yaakapp/cli-win32-x64\n run: npm publish --provenance --access public --tag \"$NPM_TAG\"\n working-directory: npm/cli-win32-x64\n\n - name: Publish @yaakapp/cli\n run: npm publish --provenance --access public --tag \"$NPM_TAG\"\n working-directory: npm/cli\n" }, { "path": ".github/workflows/sponsors.yml", "content": "name: Generate Sponsors README\non:\n workflow_dispatch:\n schedule:\n - cron: 30 15 * * 0-6\npermissions:\n contents: write\njobs:\n deploy:\n runs-on: ubuntu-latest\n steps:\n - name: Checkout πŸ›ŽοΈ\n uses: actions/checkout@v2\n\n - name: Generate Sponsors\n uses: JamesIves/github-sponsors-readme-action@v1\n with:\n token: ${{ secrets.SPONSORS_PAT }}\n file: \"README.md\"\n maximum: 1999\n template: '\"User  '\n active-only: false\n include-private: true\n marker: \"sponsors-base\"\n\n - name: Generate Sponsors\n uses: JamesIves/github-sponsors-readme-action@v1\n with:\n token: ${{ secrets.SPONSORS_PAT }}\n file: \"README.md\"\n minimum: 2000\n template: '\"User  '\n active-only: false\n include-private: true\n marker: \"sponsors-premium\"\n\n # ⚠️ Note: You can use any deployment step here to automatically push the README\n # changes back to your branch.\n - name: Commit Changes\n uses: JamesIves/github-pages-deploy-action@v4\n with:\n branch: main\n force: false\n folder: \".\"\n" }, { "path": ".gitignore", "content": "# Logs\nlogs\n*.log\nnpm-debug.log*\nyarn-debug.log*\nyarn-error.log*\npnpm-debug.log*\nlerna-debug.log*\n\nnode_modules\ndist\ndist-ssr\n*.local\n\n# Editor directories and files\n.vscode/*\n!.vscode/extensions.json\n!.vscode/settings.json\n!.vscode/launch.json\n.idea\n.DS_Store\n*.suo\n*.ntvs*\n*.njsproj\n*.sln\n*.sw?\n.eslintcache\nout\n\n*.sqlite\n*.sqlite-*\n\n.cargo\n\n.tmp\ntmp\n.zed\ncodebook.toml\ntarget\n\n# Per-worktree Tauri config (generated by post-checkout hook)\ncrates-tauri/yaak-app/tauri.worktree.conf.json\n\n# Tauri auto-generated permission files\n**/permissions/autogenerated\n**/permissions/schemas\n\n# Flatpak build artifacts\nflatpak-repo/\n.flatpak-builder/\nflatpak/flatpak-builder-tools/\nflatpak/cargo-sources.json\nflatpak/node-sources.json\n\n# Local Codex desktop env state\n.codex/environments/environment.toml\n\n# Claude Code local settings\n.claude/settings.local.json\n" }, { "path": ".node-version", "content": "24.14.0\n" }, { "path": ".npmrc", "content": "# vite-plugin-wasm has not yet declared Vite 8 in its peerDependencies\nlegacy-peer-deps=true\n" }, { "path": ".nvmrc", "content": "20\n" }, { "path": ".oxfmtignore", "content": "**/bindings/**\ncrates/yaak-templates/pkg/**\n" }, { "path": ".vite-hooks/post-checkout", "content": "node scripts/git-hooks/post-checkout.mjs \"$@\"\n" }, { "path": ".vite-hooks/pre-commit", "content": "vp lint\n" }, { "path": ".vscode/extensions.json", "content": "{\n \"recommendations\": [\n \"rust-lang.rust-analyzer\",\n \"bradlc.vscode-tailwindcss\",\n \"VoidZero.vite-plus-extension-pack\"\n ]\n}\n" }, { "path": ".vscode/launch.json", "content": "{\n \"version\": \"0.2.0\",\n \"configurations\": [\n {\n \"type\": \"node\",\n \"request\": \"launch\",\n \"name\": \"Dev App\",\n \"runtimeExecutable\": \"npm\",\n \"runtimeArgs\": [\"run\", \"start\"]\n },\n {\n \"type\": \"node\",\n \"request\": \"launch\",\n \"name\": \"Build App\",\n \"runtimeExecutable\": \"npm\",\n \"runtimeArgs\": [\"run\", \"start\"]\n },\n {\n \"type\": \"node\",\n \"request\": \"launch\",\n \"name\": \"Bootstrap\",\n \"runtimeExecutable\": \"npm\",\n \"runtimeArgs\": [\"run\", \"bootstrap\"]\n }\n ]\n}\n" }, { "path": ".vscode/settings.json", "content": "{\n \"editor.defaultFormatter\": \"oxc.oxc-vscode\",\n \"editor.formatOnSave\": true,\n \"editor.formatOnSaveMode\": \"file\",\n \"editor.codeActionsOnSave\": {\n \"source.fixAll.oxc\": \"explicit\"\n }\n}\n" }, { "path": "AGENTS.md", "content": "- Tag safety: app releases use `v*` tags and CLI releases use `yaak-cli-*` tags; always confirm which one is requested before retagging.\n- Do not commit, push, or tag without explicit approval\n" }, { "path": "CONTRIBUTING.md", "content": "# Contributing to Yaak\n\nYaak accepts community pull requests for:\n\n- Bug fixes\n- Small-scope improvements directly tied to existing behavior\n\nPull requests that introduce broad new features, major redesigns, or large refactors are out of scope unless explicitly approved first.\n\n## Approval for Non-Bugfix Changes\n\nIf your PR is not a bug fix or small-scope improvement, include a link to the approved [feedback item](https://yaak.app/feedback) where contribution approval was explicitly stated.\n\n## Development Setup\n\nFor local setup and development workflows, see [`DEVELOPMENT.md`](DEVELOPMENT.md).\n" }, { "path": "Cargo.toml", "content": "[workspace]\nresolver = \"2\"\nmembers = [\n \"crates/yaak\",\n # Shared crates (no Tauri dependency)\n \"crates/yaak-core\",\n \"crates/yaak-common\",\n \"crates/yaak-crypto\",\n \"crates/yaak-git\",\n \"crates/yaak-grpc\",\n \"crates/yaak-http\",\n \"crates/yaak-models\",\n \"crates/yaak-plugins\",\n \"crates/yaak-sse\",\n \"crates/yaak-sync\",\n \"crates/yaak-templates\",\n \"crates/yaak-tls\",\n \"crates/yaak-ws\",\n \"crates/yaak-api\",\n # CLI crates\n \"crates-cli/yaak-cli\",\n # Tauri-specific crates\n \"crates-tauri/yaak-app\",\n \"crates-tauri/yaak-fonts\",\n \"crates-tauri/yaak-license\",\n \"crates-tauri/yaak-mac-window\",\n \"crates-tauri/yaak-tauri-utils\",\n]\n\n[workspace.dependencies]\nchrono = \"0.4.42\"\nhex = \"0.4.3\"\nkeyring = \"3.6.3\"\nlog = \"0.4.29\"\nreqwest = \"0.12.20\"\nrustls = { version = \"0.23.34\", default-features = false }\nrustls-platform-verifier = \"0.6.2\"\nschemars = { version = \"0.8.22\", features = [\"chrono\"] }\nserde = \"1.0.228\"\nserde_json = \"1.0.145\"\nsha2 = \"0.10.9\"\ntauri = \"2.9.5\"\ntauri-plugin = \"2.5.2\"\ntauri-plugin-dialog = \"2.4.2\"\ntauri-plugin-shell = \"2.3.3\"\nthiserror = \"2.0.17\"\ntokio = \"1.48.0\"\nts-rs = \"11.1.0\"\n\n# Internal crates - shared\nyaak-core = { path = \"crates/yaak-core\" }\nyaak = { path = \"crates/yaak\" }\nyaak-common = { path = \"crates/yaak-common\" }\nyaak-crypto = { path = \"crates/yaak-crypto\" }\nyaak-git = { path = \"crates/yaak-git\" }\nyaak-grpc = { path = \"crates/yaak-grpc\" }\nyaak-http = { path = \"crates/yaak-http\" }\nyaak-models = { path = \"crates/yaak-models\" }\nyaak-plugins = { path = \"crates/yaak-plugins\" }\nyaak-sse = { path = \"crates/yaak-sse\" }\nyaak-sync = { path = \"crates/yaak-sync\" }\nyaak-templates = { path = \"crates/yaak-templates\" }\nyaak-tls = { path = \"crates/yaak-tls\" }\nyaak-ws = { path = \"crates/yaak-ws\" }\nyaak-api = { path = \"crates/yaak-api\" }\n\n# Internal crates - Tauri-specific\nyaak-fonts = { path = \"crates-tauri/yaak-fonts\" }\nyaak-license = { path = \"crates-tauri/yaak-license\" }\nyaak-mac-window = { path = \"crates-tauri/yaak-mac-window\" }\nyaak-tauri-utils = { path = \"crates-tauri/yaak-tauri-utils\" }\n\n[profile.release]\nstrip = false\n" }, { "path": "DEVELOPMENT.md", "content": "# Developer Setup\n\nYaak is a combined Node.js and Rust monorepo. It is a [Tauri](https://tauri.app) project, so\nuses Rust and HTML/CSS/JS for the main application but there is also a plugin system powered\nby a Node.js sidecar that communicates to the app over gRPC.\n\nBecause of the moving parts, there are a few setup steps required before development can\nbegin.\n\n## Prerequisites\n\nMake sure you have the following tools installed:\n\n- [Node.js](https://nodejs.org/en/download/package-manager) (v24+)\n- [Rust](https://www.rust-lang.org/tools/install)\n- [Vite+](https://vite.dev/guide/vite-plus) (`vp` CLI)\n\nCheck the installations with the following commands:\n\n```shell\nnode -v\nnpm -v\nvp --version\nrustc --version\n```\n\nInstall the NPM dependencies:\n\n```shell\nnpm install\n```\n\nRun the `bootstrap` command to do some initial setup:\n\n```shell\nnpm run bootstrap\n```\n\n## Run the App\n\nAfter bootstrapping, start the app in development mode:\n\n```shell\nnpm start\n```\n\n## SQLite Migrations\n\nNew migrations can be created from the `src-tauri/` directory:\n\n```shell\nnpm run migration\n```\n\nRerun the app to apply the migrations.\n\n_Note: For safety, development builds use a separate database location from production builds._\n\n## Lezer Grammar Generation\n\n```sh\n# Example\nlezer-generator components/core/Editor//.grammar > components/core/Editor//.ts\n```\n\n## Linting and Formatting\n\nThis repo uses [Vite+](https://vite.dev/guide/vite-plus) for linting (oxlint) and formatting (oxfmt).\n\n- Lint the entire repo:\n\n```sh\nnpm run lint\n```\n\n- Format code:\n\n```sh\nnpm run format\n```\n\nNotes:\n\n- A pre-commit hook runs `vp lint` automatically on commit.\n- Some workspace packages also run `tsc --noEmit` for type-checking.\n- VS Code users should install the recommended extensions for format-on-save support.\n" }, { "path": "LICENSE", "content": "MIT License\n\nCopyright (c) 2024 Yaak\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.\n" }, { "path": "README.md", "content": "

\n \n \n \n

\n\n

\n πŸ’« Yaak ➟ Desktop API Client πŸ’«\n

\n\n

\n A fast, privacy-first API client for REST, GraphQL, SSE, WebSocket, and gRPC – built with Tauri, Rust, and React.\n

\n

\n Development is funded by community-purchased licenses. You can also become a sponsor to have your logo appear below. πŸ’–\n

\n
\n\n

\n \"User  \"User  \"User  \"User  \"User  \"User  \n

\n

\n \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \"User  \n

\n\n![Yaak API Client](https://yaak.app/static/screenshot.png)\n\n## Features\n\nYaak is an offline-first API client designed to stay out of your way while giving you everything you need when you need it.\nBuilt with [Tauri](https://tauri.app), Rust, and React, it’s fast, lightweight, and private. No telemetry, no VC funding, and no cloud lock-in.\n\n### 🌐 Work with any API\n\n- Import collections from Postman, Insomnia, OpenAPI, Swagger, or Curl.\n- Send requests via REST, GraphQL, gRPC, WebSocket, or Server-Sent Events.\n- Filter and inspect responses with JSONPath or XPath.\n\n### πŸ” Stay secure\n\n- Use OAuth 2.0, JWT, Basic Auth, or custom plugins for authentication.\n- Secure sensitive values with encrypted secrets.\n- Store secrets in your OS keychain.\n\n### ☁️ Organize & collaborate\n\n- Group requests into workspaces and nested folders.\n- Use environment variables to switch between dev, staging, and prod.\n- Mirror workspaces to your filesystem for versioning in Git or syncing with Dropbox.\n\n### 🧩 Extend & customize\n\n- Insert dynamic values like UUIDs or timestamps with template tags.\n- Pick from built-in themes or build your own.\n- Create plugins to extend authentication, template tags, or the UI.\n\n## Contribution Policy\n\n> [!IMPORTANT]\n> Community PRs are currently limited to bug fixes and small-scope improvements.\n> If your PR is out of scope, link an approved feedback item from [yaak.app/feedback](https://yaak.app/feedback).\n> See [`CONTRIBUTING.md`](CONTRIBUTING.md) for policy details and [`DEVELOPMENT.md`](DEVELOPMENT.md) for local setup.\n\n## Useful Resources\n\n- [Feedback and Bug Reports](https://feedback.yaak.app)\n- [Documentation](https://yaak.app/docs)\n- [Yaak vs Postman](https://yaak.app/alternatives/postman)\n- [Yaak vs Bruno](https://yaak.app/alternatives/bruno)\n- [Yaak vs Insomnia](https://yaak.app/alternatives/insomnia)\n" }, { "path": "crates/yaak/Cargo.toml", "content": "[package]\nname = \"yaak\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nasync-trait = \"0.1\"\nlog = { workspace = true }\nmd5 = \"0.8.0\"\nserde_json = { workspace = true }\nthiserror = { workspace = true }\ntokio = { workspace = true, features = [\"sync\", \"rt\"] }\nyaak-http = { workspace = true }\nyaak-crypto = { workspace = true }\nyaak-models = { workspace = true }\nyaak-plugins = { workspace = true }\nyaak-templates = { workspace = true }\nyaak-tls = { workspace = true }\n\n[dev-dependencies]\ntempfile = \"3\"\n" }, { "path": "crates/yaak/src/error.rs", "content": "use thiserror::Error;\n\n#[derive(Debug, Error)]\npub enum Error {\n #[error(transparent)]\n Send(#[from] crate::send::SendHttpRequestError),\n}\n\npub type Result = std::result::Result;\n" }, { "path": "crates/yaak/src/lib.rs", "content": "pub mod error;\npub mod plugin_events;\npub mod render;\npub mod send;\n\npub use error::Error;\npub type Result = error::Result;\n" }, { "path": "crates/yaak/src/plugin_events.rs", "content": "use yaak_models::models::AnyModel;\nuse yaak_models::query_manager::QueryManager;\nuse yaak_models::util::UpdateSource;\nuse yaak_plugins::events::{\n CloseWindowRequest, CopyTextRequest, DeleteKeyValueRequest, DeleteKeyValueResponse,\n DeleteModelRequest, DeleteModelResponse, ErrorResponse, FindHttpResponsesRequest,\n FindHttpResponsesResponse, GetCookieValueRequest, GetHttpRequestByIdRequest,\n GetHttpRequestByIdResponse, GetKeyValueRequest, GetKeyValueResponse, InternalEventPayload,\n ListCookieNamesRequest, ListFoldersRequest, ListFoldersResponse, ListHttpRequestsRequest,\n ListHttpRequestsResponse, ListOpenWorkspacesRequest, OpenExternalUrlRequest, OpenWindowRequest,\n PromptFormRequest, PromptTextRequest, ReloadResponse, RenderGrpcRequestRequest,\n RenderHttpRequestRequest, SendHttpRequestRequest, SetKeyValueRequest, ShowToastRequest,\n TemplateRenderRequest, UpsertModelRequest, UpsertModelResponse, WindowInfoRequest,\n};\n\npub struct SharedPluginEventContext<'a> {\n pub plugin_name: &'a str,\n pub workspace_id: Option<&'a str>,\n}\n\n#[derive(Debug)]\npub enum GroupedPluginEvent<'a> {\n Handled(Option),\n ToHandle(HostRequest<'a>),\n}\n\n#[derive(Debug)]\npub enum GroupedPluginRequest<'a> {\n Shared(SharedRequest<'a>),\n Host(HostRequest<'a>),\n Ignore,\n}\n\n#[derive(Debug)]\npub enum SharedRequest<'a> {\n GetKeyValue(&'a GetKeyValueRequest),\n SetKeyValue(&'a SetKeyValueRequest),\n DeleteKeyValue(&'a DeleteKeyValueRequest),\n GetHttpRequestById(&'a GetHttpRequestByIdRequest),\n ListFolders(&'a ListFoldersRequest),\n ListHttpRequests(&'a ListHttpRequestsRequest),\n FindHttpResponses(&'a FindHttpResponsesRequest),\n UpsertModel(&'a UpsertModelRequest),\n DeleteModel(&'a DeleteModelRequest),\n}\n\n#[derive(Debug)]\npub enum HostRequest<'a> {\n ShowToast(&'a ShowToastRequest),\n CopyText(&'a CopyTextRequest),\n PromptText(&'a PromptTextRequest),\n PromptForm(&'a PromptFormRequest),\n RenderGrpcRequest(&'a RenderGrpcRequestRequest),\n RenderHttpRequest(&'a RenderHttpRequestRequest),\n TemplateRender(&'a TemplateRenderRequest),\n SendHttpRequest(&'a SendHttpRequestRequest),\n OpenWindow(&'a OpenWindowRequest),\n CloseWindow(&'a CloseWindowRequest),\n OpenExternalUrl(&'a OpenExternalUrlRequest),\n ListOpenWorkspaces(&'a ListOpenWorkspacesRequest),\n ListCookieNames(&'a ListCookieNamesRequest),\n GetCookieValue(&'a GetCookieValueRequest),\n WindowInfo(&'a WindowInfoRequest),\n ErrorResponse(&'a ErrorResponse),\n ReloadResponse(&'a ReloadResponse),\n OtherRequest(&'a InternalEventPayload),\n}\n\nimpl HostRequest<'_> {\n pub fn type_name(&self) -> String {\n match self {\n HostRequest::ShowToast(_) => \"show_toast_request\".to_string(),\n HostRequest::CopyText(_) => \"copy_text_request\".to_string(),\n HostRequest::PromptText(_) => \"prompt_text_request\".to_string(),\n HostRequest::PromptForm(_) => \"prompt_form_request\".to_string(),\n HostRequest::RenderGrpcRequest(_) => \"render_grpc_request_request\".to_string(),\n HostRequest::RenderHttpRequest(_) => \"render_http_request_request\".to_string(),\n HostRequest::TemplateRender(_) => \"template_render_request\".to_string(),\n HostRequest::SendHttpRequest(_) => \"send_http_request_request\".to_string(),\n HostRequest::OpenWindow(_) => \"open_window_request\".to_string(),\n HostRequest::CloseWindow(_) => \"close_window_request\".to_string(),\n HostRequest::OpenExternalUrl(_) => \"open_external_url_request\".to_string(),\n HostRequest::ListOpenWorkspaces(_) => \"list_open_workspaces_request\".to_string(),\n HostRequest::ListCookieNames(_) => \"list_cookie_names_request\".to_string(),\n HostRequest::GetCookieValue(_) => \"get_cookie_value_request\".to_string(),\n HostRequest::WindowInfo(_) => \"window_info_request\".to_string(),\n HostRequest::ErrorResponse(_) => \"error_response\".to_string(),\n HostRequest::ReloadResponse(_) => \"reload_response\".to_string(),\n HostRequest::OtherRequest(payload) => payload.type_name(),\n }\n }\n}\n\nimpl<'a> From<&'a InternalEventPayload> for GroupedPluginRequest<'a> {\n fn from(payload: &'a InternalEventPayload) -> Self {\n match payload {\n InternalEventPayload::GetKeyValueRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::GetKeyValue(req))\n }\n InternalEventPayload::SetKeyValueRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::SetKeyValue(req))\n }\n InternalEventPayload::DeleteKeyValueRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::DeleteKeyValue(req))\n }\n InternalEventPayload::GetHttpRequestByIdRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::GetHttpRequestById(req))\n }\n InternalEventPayload::ErrorResponse(resp) => {\n GroupedPluginRequest::Host(HostRequest::ErrorResponse(resp))\n }\n InternalEventPayload::ReloadResponse(req) => {\n GroupedPluginRequest::Host(HostRequest::ReloadResponse(req))\n }\n InternalEventPayload::ListOpenWorkspacesRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::ListOpenWorkspaces(req))\n }\n InternalEventPayload::ListFoldersRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::ListFolders(req))\n }\n InternalEventPayload::ListHttpRequestsRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::ListHttpRequests(req))\n }\n InternalEventPayload::ShowToastRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::ShowToast(req))\n }\n InternalEventPayload::CopyTextRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::CopyText(req))\n }\n InternalEventPayload::PromptTextRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::PromptText(req))\n }\n InternalEventPayload::PromptFormRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::PromptForm(req))\n }\n InternalEventPayload::FindHttpResponsesRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::FindHttpResponses(req))\n }\n InternalEventPayload::UpsertModelRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::UpsertModel(req))\n }\n InternalEventPayload::DeleteModelRequest(req) => {\n GroupedPluginRequest::Shared(SharedRequest::DeleteModel(req))\n }\n InternalEventPayload::RenderGrpcRequestRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::RenderGrpcRequest(req))\n }\n InternalEventPayload::RenderHttpRequestRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::RenderHttpRequest(req))\n }\n InternalEventPayload::TemplateRenderRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::TemplateRender(req))\n }\n InternalEventPayload::SendHttpRequestRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::SendHttpRequest(req))\n }\n InternalEventPayload::OpenWindowRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::OpenWindow(req))\n }\n InternalEventPayload::CloseWindowRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::CloseWindow(req))\n }\n InternalEventPayload::OpenExternalUrlRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::OpenExternalUrl(req))\n }\n InternalEventPayload::ListCookieNamesRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::ListCookieNames(req))\n }\n InternalEventPayload::GetCookieValueRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::GetCookieValue(req))\n }\n InternalEventPayload::WindowInfoRequest(req) => {\n GroupedPluginRequest::Host(HostRequest::WindowInfo(req))\n }\n payload if payload.type_name().ends_with(\"_request\") => {\n GroupedPluginRequest::Host(HostRequest::OtherRequest(payload))\n }\n _ => GroupedPluginRequest::Ignore,\n }\n }\n}\n\npub fn handle_shared_plugin_event<'a>(\n query_manager: &QueryManager,\n payload: &'a InternalEventPayload,\n context: SharedPluginEventContext<'_>,\n) -> GroupedPluginEvent<'a> {\n match GroupedPluginRequest::from(payload) {\n GroupedPluginRequest::Shared(req) => {\n GroupedPluginEvent::Handled(Some(build_shared_reply(query_manager, req, context)))\n }\n GroupedPluginRequest::Host(req) => GroupedPluginEvent::ToHandle(req),\n GroupedPluginRequest::Ignore => GroupedPluginEvent::Handled(None),\n }\n}\n\nfn build_shared_reply(\n query_manager: &QueryManager,\n request: SharedRequest<'_>,\n context: SharedPluginEventContext<'_>,\n) -> InternalEventPayload {\n match request {\n SharedRequest::GetKeyValue(req) => {\n let value = query_manager\n .connect()\n .get_plugin_key_value(context.plugin_name, &req.key)\n .map(|v| v.value);\n InternalEventPayload::GetKeyValueResponse(GetKeyValueResponse { value })\n }\n SharedRequest::SetKeyValue(req) => {\n query_manager.connect().set_plugin_key_value(context.plugin_name, &req.key, &req.value);\n InternalEventPayload::SetKeyValueResponse(yaak_plugins::events::SetKeyValueResponse {})\n }\n SharedRequest::DeleteKeyValue(req) => {\n match query_manager.connect().delete_plugin_key_value(context.plugin_name, &req.key) {\n Ok(deleted) => {\n InternalEventPayload::DeleteKeyValueResponse(DeleteKeyValueResponse { deleted })\n }\n Err(err) => InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to delete plugin key '{}' : {err}\", req.key),\n }),\n }\n }\n SharedRequest::GetHttpRequestById(req) => {\n let http_request = query_manager.connect().get_http_request(&req.id).ok();\n InternalEventPayload::GetHttpRequestByIdResponse(GetHttpRequestByIdResponse {\n http_request,\n })\n }\n SharedRequest::ListFolders(_) => {\n let Some(workspace_id) = context.workspace_id else {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: \"workspace_id is required for list_folders_request\".to_string(),\n });\n };\n let folders = match query_manager.connect().list_folders(workspace_id) {\n Ok(folders) => folders,\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to list folders: {err}\"),\n });\n }\n };\n InternalEventPayload::ListFoldersResponse(ListFoldersResponse { folders })\n }\n SharedRequest::ListHttpRequests(req) => {\n let http_requests = if let Some(folder_id) = req.folder_id.as_deref() {\n match query_manager.connect().list_http_requests_for_folder_recursive(folder_id) {\n Ok(http_requests) => http_requests,\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to list HTTP requests for folder: {err}\"),\n });\n }\n }\n } else {\n let Some(workspace_id) = context.workspace_id else {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error:\n \"workspace_id is required for list_http_requests_request without folder_id\"\n .to_string(),\n });\n };\n match query_manager.connect().list_http_requests(workspace_id) {\n Ok(http_requests) => http_requests,\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to list HTTP requests: {err}\"),\n });\n }\n }\n };\n InternalEventPayload::ListHttpRequestsResponse(ListHttpRequestsResponse {\n http_requests,\n })\n }\n SharedRequest::FindHttpResponses(req) => {\n let http_responses = query_manager\n .connect()\n .list_http_responses_for_request(&req.request_id, req.limit.map(|l| l as u64))\n .unwrap_or_default();\n InternalEventPayload::FindHttpResponsesResponse(FindHttpResponsesResponse {\n http_responses,\n })\n }\n SharedRequest::UpsertModel(req) => {\n use AnyModel::*;\n\n let model = match &req.model {\n HttpRequest(m) => {\n match query_manager.connect().upsert_http_request(m, &UpdateSource::Plugin) {\n Ok(model) => HttpRequest(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to upsert HTTP request: {err}\"),\n });\n }\n }\n }\n GrpcRequest(m) => {\n match query_manager.connect().upsert_grpc_request(m, &UpdateSource::Plugin) {\n Ok(model) => GrpcRequest(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to upsert gRPC request: {err}\"),\n });\n }\n }\n }\n WebsocketRequest(m) => {\n match query_manager.connect().upsert_websocket_request(m, &UpdateSource::Plugin)\n {\n Ok(model) => WebsocketRequest(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to upsert WebSocket request: {err}\"),\n });\n }\n }\n }\n Folder(m) => {\n match query_manager.connect().upsert_folder(m, &UpdateSource::Plugin) {\n Ok(model) => Folder(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to upsert folder: {err}\"),\n });\n }\n }\n }\n Environment(m) => {\n match query_manager.connect().upsert_environment(m, &UpdateSource::Plugin) {\n Ok(model) => Environment(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to upsert environment: {err}\"),\n });\n }\n }\n }\n Workspace(m) => {\n match query_manager.connect().upsert_workspace(m, &UpdateSource::Plugin) {\n Ok(model) => Workspace(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to upsert workspace: {err}\"),\n });\n }\n }\n }\n _ => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: \"Upsert not supported for this model type\".to_string(),\n });\n }\n };\n\n InternalEventPayload::UpsertModelResponse(UpsertModelResponse { model })\n }\n SharedRequest::DeleteModel(req) => {\n let model = match req.model.as_str() {\n \"http_request\" => {\n match query_manager\n .connect()\n .delete_http_request_by_id(&req.id, &UpdateSource::Plugin)\n {\n Ok(model) => AnyModel::HttpRequest(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to delete HTTP request: {err}\"),\n });\n }\n }\n }\n \"grpc_request\" => {\n match query_manager\n .connect()\n .delete_grpc_request_by_id(&req.id, &UpdateSource::Plugin)\n {\n Ok(model) => AnyModel::GrpcRequest(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to delete gRPC request: {err}\"),\n });\n }\n }\n }\n \"websocket_request\" => {\n match query_manager\n .connect()\n .delete_websocket_request_by_id(&req.id, &UpdateSource::Plugin)\n {\n Ok(model) => AnyModel::WebsocketRequest(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to delete WebSocket request: {err}\"),\n });\n }\n }\n }\n \"folder\" => match query_manager\n .connect()\n .delete_folder_by_id(&req.id, &UpdateSource::Plugin)\n {\n Ok(model) => AnyModel::Folder(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to delete folder: {err}\"),\n });\n }\n },\n \"environment\" => {\n match query_manager\n .connect()\n .delete_environment_by_id(&req.id, &UpdateSource::Plugin)\n {\n Ok(model) => AnyModel::Environment(model),\n Err(err) => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: format!(\"Failed to delete environment: {err}\"),\n });\n }\n }\n }\n _ => {\n return InternalEventPayload::ErrorResponse(ErrorResponse {\n error: \"Delete not supported for this model type\".to_string(),\n });\n }\n };\n\n InternalEventPayload::DeleteModelResponse(DeleteModelResponse { model })\n }\n }\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n use tempfile::TempDir;\n use yaak_models::models::{AnyModel, Folder, HttpRequest, Workspace};\n use yaak_models::util::UpdateSource;\n\n fn seed_query_manager() -> (QueryManager, TempDir) {\n let temp_dir = TempDir::new().expect(\"Failed to create temp dir\");\n let db_path = temp_dir.path().join(\"db.sqlite\");\n let blob_path = temp_dir.path().join(\"blobs.sqlite\");\n let (query_manager, _blob_manager, _rx) =\n yaak_models::init_standalone(&db_path, &blob_path).expect(\"Failed to initialize DB\");\n\n query_manager\n .connect()\n .upsert_workspace(\n &Workspace {\n id: \"wk_test\".to_string(),\n name: \"Workspace\".to_string(),\n ..Default::default()\n },\n &UpdateSource::Sync,\n )\n .expect(\"Failed to seed workspace\");\n\n query_manager\n .connect()\n .upsert_folder(\n &Folder {\n id: \"fl_test\".to_string(),\n workspace_id: \"wk_test\".to_string(),\n name: \"Folder\".to_string(),\n ..Default::default()\n },\n &UpdateSource::Sync,\n )\n .expect(\"Failed to seed folder\");\n\n query_manager\n .connect()\n .upsert_http_request(\n &HttpRequest {\n id: \"rq_test\".to_string(),\n workspace_id: \"wk_test\".to_string(),\n folder_id: Some(\"fl_test\".to_string()),\n name: \"Request\".to_string(),\n method: \"GET\".to_string(),\n url: \"https://example.com\".to_string(),\n ..Default::default()\n },\n &UpdateSource::Sync,\n )\n .expect(\"Failed to seed request\");\n\n (query_manager, temp_dir)\n }\n\n #[test]\n fn list_requests_requires_workspace_when_folder_missing() {\n let (query_manager, _temp_dir) = seed_query_manager();\n let payload = InternalEventPayload::ListHttpRequestsRequest(\n yaak_plugins::events::ListHttpRequestsRequest { folder_id: None },\n );\n let result = handle_shared_plugin_event(\n &query_manager,\n &payload,\n SharedPluginEventContext { plugin_name: \"@yaak/test\", workspace_id: None },\n );\n\n assert!(matches!(\n result,\n GroupedPluginEvent::Handled(Some(InternalEventPayload::ErrorResponse(_)))\n ));\n }\n\n #[test]\n fn list_requests_by_workspace_and_folder() {\n let (query_manager, _temp_dir) = seed_query_manager();\n\n let by_workspace_payload = InternalEventPayload::ListHttpRequestsRequest(\n yaak_plugins::events::ListHttpRequestsRequest { folder_id: None },\n );\n let by_workspace = handle_shared_plugin_event(\n &query_manager,\n &by_workspace_payload,\n SharedPluginEventContext { plugin_name: \"@yaak/test\", workspace_id: Some(\"wk_test\") },\n );\n match by_workspace {\n GroupedPluginEvent::Handled(Some(InternalEventPayload::ListHttpRequestsResponse(\n resp,\n ))) => {\n assert_eq!(resp.http_requests.len(), 1);\n }\n other => panic!(\"unexpected workspace response: {other:?}\"),\n }\n\n let by_folder_payload = InternalEventPayload::ListHttpRequestsRequest(\n yaak_plugins::events::ListHttpRequestsRequest {\n folder_id: Some(\"fl_test\".to_string()),\n },\n );\n let by_folder = handle_shared_plugin_event(\n &query_manager,\n &by_folder_payload,\n SharedPluginEventContext { plugin_name: \"@yaak/test\", workspace_id: None },\n );\n match by_folder {\n GroupedPluginEvent::Handled(Some(InternalEventPayload::ListHttpRequestsResponse(\n resp,\n ))) => {\n assert_eq!(resp.http_requests.len(), 1);\n }\n other => panic!(\"unexpected folder response: {other:?}\"),\n }\n }\n\n #[test]\n fn find_http_responses_is_shared_handled() {\n let (query_manager, _temp_dir) = seed_query_manager();\n let payload = InternalEventPayload::FindHttpResponsesRequest(FindHttpResponsesRequest {\n request_id: \"rq_test\".to_string(),\n limit: Some(1),\n });\n\n let result = handle_shared_plugin_event(\n &query_manager,\n &payload,\n SharedPluginEventContext { plugin_name: \"@yaak/test\", workspace_id: Some(\"wk_test\") },\n );\n\n match result {\n GroupedPluginEvent::Handled(Some(InternalEventPayload::FindHttpResponsesResponse(\n resp,\n ))) => {\n assert!(resp.http_responses.is_empty());\n }\n other => panic!(\"unexpected find responses result: {other:?}\"),\n }\n }\n\n #[test]\n fn upsert_and_delete_model_are_shared_handled() {\n let (query_manager, _temp_dir) = seed_query_manager();\n\n let existing = query_manager\n .connect()\n .get_http_request(\"rq_test\")\n .expect(\"Failed to load seeded request\");\n let upsert_payload = InternalEventPayload::UpsertModelRequest(UpsertModelRequest {\n model: AnyModel::HttpRequest(HttpRequest {\n name: \"Request Updated\".to_string(),\n ..existing\n }),\n });\n\n let upsert_result = handle_shared_plugin_event(\n &query_manager,\n &upsert_payload,\n SharedPluginEventContext { plugin_name: \"@yaak/test\", workspace_id: Some(\"wk_test\") },\n );\n match upsert_result {\n GroupedPluginEvent::Handled(Some(InternalEventPayload::UpsertModelResponse(resp))) => {\n match resp.model {\n AnyModel::HttpRequest(r) => assert_eq!(r.name, \"Request Updated\"),\n other => panic!(\"unexpected upsert model type: {other:?}\"),\n }\n }\n other => panic!(\"unexpected upsert result: {other:?}\"),\n }\n\n let delete_payload = InternalEventPayload::DeleteModelRequest(DeleteModelRequest {\n model: \"http_request\".to_string(),\n id: \"rq_test\".to_string(),\n });\n let delete_result = handle_shared_plugin_event(\n &query_manager,\n &delete_payload,\n SharedPluginEventContext { plugin_name: \"@yaak/test\", workspace_id: Some(\"wk_test\") },\n );\n match delete_result {\n GroupedPluginEvent::Handled(Some(InternalEventPayload::DeleteModelResponse(resp))) => {\n match resp.model {\n AnyModel::HttpRequest(r) => assert_eq!(r.id, \"rq_test\"),\n other => panic!(\"unexpected delete model type: {other:?}\"),\n }\n }\n other => panic!(\"unexpected delete result: {other:?}\"),\n }\n }\n\n #[test]\n fn host_request_classification_works() {\n let (query_manager, _temp_dir) = seed_query_manager();\n let payload = InternalEventPayload::WindowInfoRequest(WindowInfoRequest {\n label: \"main\".to_string(),\n });\n let result = handle_shared_plugin_event(\n &query_manager,\n &payload,\n SharedPluginEventContext { plugin_name: \"@yaak/test\", workspace_id: None },\n );\n\n match result {\n GroupedPluginEvent::ToHandle(HostRequest::WindowInfo(req)) => {\n assert_eq!(req.label, \"main\")\n }\n other => panic!(\"unexpected host classification: {other:?}\"),\n }\n }\n}\n" }, { "path": "crates/yaak/src/render.rs", "content": "use log::info;\nuse serde_json::Value;\nuse std::collections::BTreeMap;\nuse yaak_http::path_placeholders::apply_path_placeholders;\nuse yaak_models::models::{Environment, GrpcRequest, HttpRequest, HttpRequestHeader, HttpUrlParameter};\nuse yaak_models::render::make_vars_hashmap;\nuse yaak_templates::{RenderOptions, TemplateCallback, parse_and_render, render_json_value_raw};\n\npub async fn render_http_request(\n request: &HttpRequest,\n environment_chain: Vec,\n callback: &T,\n options: &RenderOptions,\n) -> yaak_templates::error::Result {\n let vars = &make_vars_hashmap(environment_chain);\n\n let mut url_parameters = Vec::new();\n for parameter in request.url_parameters.clone() {\n if !parameter.enabled {\n continue;\n }\n\n url_parameters.push(HttpUrlParameter {\n enabled: parameter.enabled,\n name: parse_and_render(parameter.name.as_str(), vars, callback, options).await?,\n value: parse_and_render(parameter.value.as_str(), vars, callback, options).await?,\n id: parameter.id,\n })\n }\n\n let mut headers = Vec::new();\n for header in request.headers.clone() {\n if !header.enabled {\n continue;\n }\n\n headers.push(HttpRequestHeader {\n enabled: header.enabled,\n name: parse_and_render(header.name.as_str(), vars, callback, options).await?,\n value: parse_and_render(header.value.as_str(), vars, callback, options).await?,\n id: header.id,\n })\n }\n\n let mut body = BTreeMap::new();\n for (key, value) in request.body.clone() {\n let value = if key == \"form\" { strip_disabled_form_entries(value) } else { value };\n body.insert(key, render_json_value_raw(value, vars, callback, options).await?);\n }\n\n let authentication = {\n let mut disabled = false;\n let mut auth = BTreeMap::new();\n\n match request.authentication.get(\"disabled\") {\n Some(Value::Bool(true)) => {\n disabled = true;\n }\n Some(Value::String(template)) => {\n disabled = parse_and_render(template.as_str(), vars, callback, options)\n .await\n .unwrap_or_default()\n .is_empty();\n info!(\n \"Rendering authentication.disabled as a template: {disabled} from \\\"{template}\\\"\"\n );\n }\n _ => {}\n }\n\n if disabled {\n auth.insert(\"disabled\".to_string(), Value::Bool(true));\n } else {\n for (key, value) in request.authentication.clone() {\n if key == \"disabled\" {\n auth.insert(key, Value::Bool(false));\n } else {\n auth.insert(key, render_json_value_raw(value, vars, callback, options).await?);\n }\n }\n }\n\n auth\n };\n\n let url = parse_and_render(request.url.clone().as_str(), vars, callback, options).await?;\n let (url, url_parameters) = apply_path_placeholders(&url, &url_parameters);\n\n Ok(HttpRequest { url, url_parameters, headers, body, authentication, ..request.to_owned() })\n}\n\npub async fn render_grpc_request(\n r: &GrpcRequest,\n environment_chain: Vec,\n cb: &T,\n opt: &RenderOptions,\n) -> yaak_templates::error::Result {\n let vars = &make_vars_hashmap(environment_chain);\n\n let mut metadata = Vec::new();\n for p in r.metadata.clone() {\n if !p.enabled {\n continue;\n }\n metadata.push(HttpRequestHeader {\n enabled: p.enabled,\n name: parse_and_render(p.name.as_str(), vars, cb, opt).await?,\n value: parse_and_render(p.value.as_str(), vars, cb, opt).await?,\n id: p.id,\n })\n }\n\n let authentication = {\n let mut disabled = false;\n let mut auth = BTreeMap::new();\n match r.authentication.get(\"disabled\") {\n Some(Value::Bool(true)) => {\n disabled = true;\n }\n Some(Value::String(tmpl)) => {\n disabled = parse_and_render(tmpl.as_str(), vars, cb, opt)\n .await\n .unwrap_or_default()\n .is_empty();\n info!(\n \"Rendering authentication.disabled as a template: {disabled} from \\\"{tmpl}\\\"\"\n );\n }\n _ => {}\n }\n if disabled {\n auth.insert(\"disabled\".to_string(), Value::Bool(true));\n } else {\n for (k, v) in r.authentication.clone() {\n if k == \"disabled\" {\n auth.insert(k, Value::Bool(false));\n } else {\n auth.insert(k, render_json_value_raw(v, vars, cb, opt).await?);\n }\n }\n }\n auth\n };\n\n let url = parse_and_render(r.url.as_str(), vars, cb, opt).await?;\n\n Ok(GrpcRequest { url, metadata, authentication, ..r.to_owned() })\n}\n\nfn strip_disabled_form_entries(v: Value) -> Value {\n match v {\n Value::Array(items) => Value::Array(\n items\n .into_iter()\n .filter(|item| item.get(\"enabled\").and_then(|e| e.as_bool()).unwrap_or(true))\n .collect(),\n ),\n v => v,\n }\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n use serde_json::json;\n\n #[test]\n fn test_strip_disabled_form_entries() {\n let input = json!([\n {\"enabled\": true, \"name\": \"foo\", \"value\": \"bar\"},\n {\"enabled\": false, \"name\": \"disabled\", \"value\": \"gone\"},\n {\"enabled\": true, \"name\": \"baz\", \"value\": \"qux\"},\n ]);\n let result = strip_disabled_form_entries(input);\n assert_eq!(\n result,\n json!([\n {\"enabled\": true, \"name\": \"foo\", \"value\": \"bar\"},\n {\"enabled\": true, \"name\": \"baz\", \"value\": \"qux\"},\n ])\n );\n }\n\n #[test]\n fn test_strip_disabled_form_entries_all_disabled() {\n let input = json!([\n {\"enabled\": false, \"name\": \"a\", \"value\": \"b\"},\n {\"enabled\": false, \"name\": \"c\", \"value\": \"d\"},\n ]);\n let result = strip_disabled_form_entries(input);\n assert_eq!(result, json!([]));\n }\n\n #[test]\n fn test_strip_disabled_form_entries_missing_enabled_defaults_to_kept() {\n let input = json!([\n {\"name\": \"no_enabled_field\", \"value\": \"kept\"},\n {\"enabled\": false, \"name\": \"disabled\", \"value\": \"gone\"},\n ]);\n let result = strip_disabled_form_entries(input);\n assert_eq!(\n result,\n json!([\n {\"name\": \"no_enabled_field\", \"value\": \"kept\"},\n ])\n );\n }\n\n #[test]\n fn test_strip_disabled_form_entries_non_array_passthrough() {\n let input = json!(\"just a string\");\n let result = strip_disabled_form_entries(input.clone());\n assert_eq!(result, input);\n }\n}\n" }, { "path": "crates/yaak/src/send.rs", "content": "use crate::render::render_http_request;\nuse async_trait::async_trait;\nuse log::warn;\nuse std::path::{Path, PathBuf};\nuse std::sync::Arc;\nuse std::sync::atomic::{AtomicI32, Ordering};\nuse std::time::Instant;\nuse thiserror::Error;\nuse tokio::fs::File;\nuse tokio::io::{AsyncReadExt, AsyncWriteExt};\nuse tokio::sync::mpsc;\nuse tokio::sync::watch;\nuse yaak_crypto::manager::EncryptionManager;\nuse yaak_http::client::{\n HttpConnectionOptions, HttpConnectionProxySetting, HttpConnectionProxySettingAuth,\n};\nuse yaak_http::cookies::CookieStore;\nuse yaak_http::manager::HttpConnectionManager;\nuse yaak_http::sender::{HttpResponseEvent as SenderHttpResponseEvent, ReqwestSender};\nuse yaak_http::tee_reader::TeeReader;\nuse yaak_http::transaction::HttpTransaction;\nuse yaak_http::types::{\n SendableBody, SendableHttpRequest, SendableHttpRequestOptions, append_query_params,\n};\nuse yaak_models::blob_manager::{BlobManager, BodyChunk};\nuse yaak_models::models::{\n ClientCertificate, CookieJar, DnsOverride, Environment, HttpRequest, HttpResponse,\n HttpResponseEvent, HttpResponseHeader, HttpResponseState, ProxySetting, ProxySettingAuth,\n};\nuse yaak_models::query_manager::QueryManager;\nuse yaak_models::util::{UpdateSource, generate_prefixed_id};\nuse yaak_plugins::events::{\n CallHttpAuthenticationRequest, HttpHeader, PluginContext, RenderPurpose,\n};\nuse yaak_plugins::manager::PluginManager;\nuse yaak_plugins::template_callback::PluginTemplateCallback;\nuse yaak_templates::{RenderOptions, TemplateCallback};\nuse yaak_tls::find_client_certificate;\n\nconst HTTP_EVENT_CHANNEL_CAPACITY: usize = 100;\nconst REQUEST_BODY_CHUNK_SIZE: usize = 1024 * 1024;\nconst RESPONSE_PROGRESS_UPDATE_INTERVAL_MS: u128 = 100;\n\n#[derive(Debug, Error)]\npub enum SendHttpRequestError {\n #[error(\"Failed to load request: {0}\")]\n LoadRequest(#[source] yaak_models::error::Error),\n\n #[error(\"Failed to load workspace: {0}\")]\n LoadWorkspace(#[source] yaak_models::error::Error),\n\n #[error(\"Failed to resolve environments: {0}\")]\n ResolveEnvironments(#[source] yaak_models::error::Error),\n\n #[error(\"Failed to resolve inherited request settings: {0}\")]\n ResolveRequestInheritance(#[source] yaak_models::error::Error),\n\n #[error(\"Failed to load cookie jar: {0}\")]\n LoadCookieJar(#[source] yaak_models::error::Error),\n\n #[error(\"Failed to persist cookie jar: {0}\")]\n PersistCookieJar(#[source] yaak_models::error::Error),\n\n #[error(\"Failed to render request templates: {0}\")]\n RenderRequest(#[source] yaak_templates::error::Error),\n\n #[error(\"Failed to prepare request before send: {0}\")]\n PrepareSendableRequest(String),\n\n #[error(\"Failed to persist response metadata: {0}\")]\n PersistResponse(#[source] yaak_models::error::Error),\n\n #[error(\"Failed to create HTTP client: {0}\")]\n CreateHttpClient(#[source] yaak_http::error::Error),\n\n #[error(\"Failed to build sendable request: {0}\")]\n BuildSendableRequest(#[source] yaak_http::error::Error),\n\n #[error(\"Failed to send request: {0}\")]\n SendRequest(#[source] yaak_http::error::Error),\n\n #[error(\"Failed to read response body: {0}\")]\n ReadResponseBody(#[source] yaak_http::error::Error),\n\n #[error(\"Failed to create response directory {path:?}: {source}\")]\n CreateResponseDirectory {\n path: PathBuf,\n #[source]\n source: std::io::Error,\n },\n\n #[error(\"Failed to write response body to {path:?}: {source}\")]\n WriteResponseBody {\n path: PathBuf,\n #[source]\n source: std::io::Error,\n },\n}\n\npub type Result = std::result::Result;\n\n#[async_trait]\npub trait PrepareSendableRequest: Send + Sync {\n async fn prepare_sendable_request(\n &self,\n rendered_request: &HttpRequest,\n auth_context_id: &str,\n sendable_request: &mut SendableHttpRequest,\n ) -> std::result::Result<(), String>;\n}\n\n#[async_trait]\npub trait SendRequestExecutor: Send + Sync {\n async fn send(\n &self,\n sendable_request: SendableHttpRequest,\n event_tx: mpsc::Sender,\n cookie_store: Option,\n ) -> yaak_http::error::Result;\n}\n\nstruct DefaultSendRequestExecutor;\n\n#[async_trait]\nimpl SendRequestExecutor for DefaultSendRequestExecutor {\n async fn send(\n &self,\n sendable_request: SendableHttpRequest,\n event_tx: mpsc::Sender,\n cookie_store: Option,\n ) -> yaak_http::error::Result {\n let sender = ReqwestSender::new()?;\n let transaction = match cookie_store {\n Some(store) => HttpTransaction::with_cookie_store(sender, store),\n None => HttpTransaction::new(sender),\n };\n let (_cancel_tx, cancel_rx) = watch::channel(false);\n transaction.execute_with_cancellation(sendable_request, cancel_rx, event_tx).await\n }\n}\n\nstruct PluginPrepareSendableRequest {\n plugin_manager: Arc,\n plugin_context: PluginContext,\n cancelled_rx: Option>,\n}\n\n#[async_trait]\nimpl PrepareSendableRequest for PluginPrepareSendableRequest {\n async fn prepare_sendable_request(\n &self,\n rendered_request: &HttpRequest,\n auth_context_id: &str,\n sendable_request: &mut SendableHttpRequest,\n ) -> std::result::Result<(), String> {\n if let Some(cancelled_rx) = &self.cancelled_rx {\n let mut cancelled_rx = cancelled_rx.clone();\n tokio::select! {\n result = apply_plugin_authentication(\n sendable_request,\n rendered_request,\n auth_context_id,\n &self.plugin_manager,\n &self.plugin_context,\n ) => result,\n _ = cancelled_rx.changed() => Err(\"Request canceled\".to_string()),\n }\n } else {\n apply_plugin_authentication(\n sendable_request,\n rendered_request,\n auth_context_id,\n &self.plugin_manager,\n &self.plugin_context,\n )\n .await\n }\n }\n}\n\nstruct ConnectionManagerSendRequestExecutor<'a> {\n connection_manager: &'a HttpConnectionManager,\n plugin_context_id: String,\n query_manager: QueryManager,\n workspace_id: String,\n cancelled_rx: Option>,\n}\n\n#[async_trait]\nimpl SendRequestExecutor for ConnectionManagerSendRequestExecutor<'_> {\n async fn send(\n &self,\n sendable_request: SendableHttpRequest,\n event_tx: mpsc::Sender,\n cookie_store: Option,\n ) -> yaak_http::error::Result {\n let runtime_config =\n resolve_http_send_runtime_config(&self.query_manager, &self.workspace_id)\n .map_err(|e| yaak_http::error::Error::RequestError(e.to_string()))?;\n let client_certificate =\n find_client_certificate(&sendable_request.url, &runtime_config.client_certificates);\n let cached_client = self\n .connection_manager\n .get_client(&HttpConnectionOptions {\n id: self.plugin_context_id.clone(),\n validate_certificates: runtime_config.validate_certificates,\n proxy: runtime_config.proxy,\n client_certificate,\n dns_overrides: runtime_config.dns_overrides,\n })\n .await?;\n\n cached_client.resolver.set_event_sender(Some(event_tx.clone())).await;\n\n let sender = ReqwestSender::with_client(cached_client.client);\n let transaction = match cookie_store {\n Some(cs) => HttpTransaction::with_cookie_store(sender, cs),\n None => HttpTransaction::new(sender),\n };\n\n let result = if let Some(cancelled_rx) = self.cancelled_rx.clone() {\n transaction.execute_with_cancellation(sendable_request, cancelled_rx, event_tx).await\n } else {\n let (_cancel_tx, cancel_rx) = watch::channel(false);\n transaction.execute_with_cancellation(sendable_request, cancel_rx, event_tx).await\n };\n cached_client.resolver.set_event_sender(None).await;\n result\n }\n}\n\npub struct SendHttpRequestByIdParams<'a, T: TemplateCallback> {\n pub query_manager: &'a QueryManager,\n pub blob_manager: &'a BlobManager,\n pub request_id: &'a str,\n pub environment_id: Option<&'a str>,\n pub template_callback: &'a T,\n pub update_source: UpdateSource,\n pub cookie_jar_id: Option,\n pub response_dir: &'a Path,\n pub emit_events_to: Option>,\n pub emit_response_body_chunks_to: Option>>,\n pub cancelled_rx: Option>,\n pub prepare_sendable_request: Option<&'a dyn PrepareSendableRequest>,\n pub executor: Option<&'a dyn SendRequestExecutor>,\n}\n\npub struct SendHttpRequestParams<'a, T: TemplateCallback> {\n pub query_manager: &'a QueryManager,\n pub blob_manager: &'a BlobManager,\n pub request: HttpRequest,\n pub environment_id: Option<&'a str>,\n pub template_callback: &'a T,\n pub send_options: Option,\n pub update_source: UpdateSource,\n pub cookie_jar_id: Option,\n pub response_dir: &'a Path,\n pub emit_events_to: Option>,\n pub emit_response_body_chunks_to: Option>>,\n pub cancelled_rx: Option>,\n pub auth_context_id: Option,\n pub existing_response: Option,\n pub prepare_sendable_request: Option<&'a dyn PrepareSendableRequest>,\n pub executor: Option<&'a dyn SendRequestExecutor>,\n}\n\npub struct SendHttpRequestWithPluginsParams<'a> {\n pub query_manager: &'a QueryManager,\n pub blob_manager: &'a BlobManager,\n pub request: HttpRequest,\n pub environment_id: Option<&'a str>,\n pub update_source: UpdateSource,\n pub cookie_jar_id: Option,\n pub response_dir: &'a Path,\n pub emit_events_to: Option>,\n pub emit_response_body_chunks_to: Option>>,\n pub existing_response: Option,\n pub plugin_manager: Arc,\n pub encryption_manager: Arc,\n pub plugin_context: &'a PluginContext,\n pub cancelled_rx: Option>,\n pub connection_manager: Option<&'a HttpConnectionManager>,\n}\n\npub struct SendHttpRequestByIdWithPluginsParams<'a> {\n pub query_manager: &'a QueryManager,\n pub blob_manager: &'a BlobManager,\n pub request_id: &'a str,\n pub environment_id: Option<&'a str>,\n pub update_source: UpdateSource,\n pub cookie_jar_id: Option,\n pub response_dir: &'a Path,\n pub emit_events_to: Option>,\n pub emit_response_body_chunks_to: Option>>,\n pub plugin_manager: Arc,\n pub encryption_manager: Arc,\n pub plugin_context: &'a PluginContext,\n pub cancelled_rx: Option>,\n pub connection_manager: Option<&'a HttpConnectionManager>,\n}\n\npub struct SendHttpRequestResult {\n pub rendered_request: HttpRequest,\n pub response: HttpResponse,\n pub response_body: Vec,\n}\n\npub struct HttpSendRuntimeConfig {\n pub send_options: SendableHttpRequestOptions,\n pub validate_certificates: bool,\n pub proxy: HttpConnectionProxySetting,\n pub dns_overrides: Vec,\n pub client_certificates: Vec,\n}\n\npub fn resolve_http_send_runtime_config(\n query_manager: &QueryManager,\n workspace_id: &str,\n) -> Result {\n let db = query_manager.connect();\n let workspace = db.get_workspace(workspace_id).map_err(SendHttpRequestError::LoadWorkspace)?;\n let settings = db.get_settings();\n\n Ok(HttpSendRuntimeConfig {\n send_options: SendableHttpRequestOptions {\n follow_redirects: workspace.setting_follow_redirects,\n timeout: if workspace.setting_request_timeout > 0 {\n Some(std::time::Duration::from_millis(\n workspace.setting_request_timeout.unsigned_abs() as u64,\n ))\n } else {\n None\n },\n },\n validate_certificates: workspace.setting_validate_certificates,\n proxy: proxy_setting_from_settings(settings.proxy),\n dns_overrides: workspace.setting_dns_overrides,\n client_certificates: settings.client_certificates,\n })\n}\n\npub async fn send_http_request_by_id_with_plugins(\n params: SendHttpRequestByIdWithPluginsParams<'_>,\n) -> Result {\n let request = params\n .query_manager\n .connect()\n .get_http_request(params.request_id)\n .map_err(SendHttpRequestError::LoadRequest)?;\n\n send_http_request_with_plugins(SendHttpRequestWithPluginsParams {\n query_manager: params.query_manager,\n blob_manager: params.blob_manager,\n request,\n environment_id: params.environment_id,\n update_source: params.update_source,\n cookie_jar_id: params.cookie_jar_id,\n response_dir: params.response_dir,\n emit_events_to: params.emit_events_to,\n emit_response_body_chunks_to: params.emit_response_body_chunks_to,\n existing_response: None,\n plugin_manager: params.plugin_manager,\n encryption_manager: params.encryption_manager,\n plugin_context: params.plugin_context,\n cancelled_rx: params.cancelled_rx,\n connection_manager: params.connection_manager,\n })\n .await\n}\n\npub async fn send_http_request_with_plugins(\n params: SendHttpRequestWithPluginsParams<'_>,\n) -> Result {\n let template_callback = PluginTemplateCallback::new(\n params.plugin_manager.clone(),\n params.encryption_manager.clone(),\n params.plugin_context,\n RenderPurpose::Send,\n );\n let auth_hook = PluginPrepareSendableRequest {\n plugin_manager: params.plugin_manager,\n plugin_context: params.plugin_context.clone(),\n cancelled_rx: params.cancelled_rx.clone(),\n };\n let executor =\n params.connection_manager.map(|connection_manager| ConnectionManagerSendRequestExecutor {\n connection_manager,\n plugin_context_id: params.plugin_context.id.clone(),\n query_manager: params.query_manager.clone(),\n workspace_id: params.request.workspace_id.clone(),\n cancelled_rx: params.cancelled_rx.clone(),\n });\n\n send_http_request(SendHttpRequestParams {\n query_manager: params.query_manager,\n blob_manager: params.blob_manager,\n request: params.request,\n environment_id: params.environment_id,\n template_callback: &template_callback,\n send_options: None,\n update_source: params.update_source,\n cookie_jar_id: params.cookie_jar_id,\n response_dir: params.response_dir,\n emit_events_to: params.emit_events_to,\n emit_response_body_chunks_to: params.emit_response_body_chunks_to,\n cancelled_rx: params.cancelled_rx,\n auth_context_id: None,\n existing_response: params.existing_response,\n prepare_sendable_request: Some(&auth_hook),\n executor: executor.as_ref().map(|e| e as &dyn SendRequestExecutor),\n })\n .await\n}\n\npub async fn send_http_request_by_id(\n params: SendHttpRequestByIdParams<'_, T>,\n) -> Result {\n let request = params\n .query_manager\n .connect()\n .get_http_request(params.request_id)\n .map_err(SendHttpRequestError::LoadRequest)?;\n let (request, auth_context_id) = resolve_inherited_request(params.query_manager, &request)?;\n\n send_http_request(SendHttpRequestParams {\n query_manager: params.query_manager,\n blob_manager: params.blob_manager,\n request,\n environment_id: params.environment_id,\n template_callback: params.template_callback,\n send_options: None,\n update_source: params.update_source,\n cookie_jar_id: params.cookie_jar_id,\n response_dir: params.response_dir,\n emit_events_to: params.emit_events_to,\n emit_response_body_chunks_to: params.emit_response_body_chunks_to,\n cancelled_rx: params.cancelled_rx,\n existing_response: None,\n prepare_sendable_request: params.prepare_sendable_request,\n executor: params.executor,\n auth_context_id: Some(auth_context_id),\n })\n .await\n}\n\npub async fn send_http_request(\n params: SendHttpRequestParams<'_, T>,\n) -> Result {\n let environment_chain =\n resolve_environment_chain(params.query_manager, ¶ms.request, params.environment_id)?;\n let (resolved_request, auth_context_id) =\n if let Some(auth_context_id) = params.auth_context_id.clone() {\n (params.request.clone(), auth_context_id)\n } else {\n resolve_inherited_request(params.query_manager, ¶ms.request)?\n };\n let runtime_config =\n resolve_http_send_runtime_config(params.query_manager, ¶ms.request.workspace_id)?;\n let send_options = params.send_options.unwrap_or(runtime_config.send_options);\n let mut cookie_jar = load_cookie_jar(params.query_manager, params.cookie_jar_id.as_deref())?;\n let cookie_store =\n cookie_jar.as_ref().map(|jar| CookieStore::from_cookies(jar.cookies.clone()));\n\n let rendered_request = render_http_request(\n &resolved_request,\n environment_chain,\n params.template_callback,\n &RenderOptions::throw(),\n )\n .await\n .map_err(SendHttpRequestError::RenderRequest)?;\n\n let mut sendable_request =\n SendableHttpRequest::from_http_request(&rendered_request, send_options)\n .await\n .map_err(SendHttpRequestError::BuildSendableRequest)?;\n\n if let Some(hook) = params.prepare_sendable_request {\n hook.prepare_sendable_request(&rendered_request, &auth_context_id, &mut sendable_request)\n .await\n .map_err(SendHttpRequestError::PrepareSendableRequest)?;\n }\n\n let request_content_length = sendable_body_length(sendable_request.body.as_ref());\n let mut response = params.existing_response.unwrap_or_default();\n response.request_id = params.request.id.clone();\n response.workspace_id = params.request.workspace_id.clone();\n response.request_content_length = request_content_length;\n response.request_headers = sendable_request\n .headers\n .iter()\n .map(|(name, value)| HttpResponseHeader { name: name.clone(), value: value.clone() })\n .collect();\n response.url = sendable_request.url.clone();\n response.state = HttpResponseState::Initialized;\n response.error = None;\n response.content_length = None;\n response.content_length_compressed = None;\n response.body_path = None;\n response.status = 0;\n response.status_reason = None;\n response.headers = Vec::new();\n response.remote_addr = None;\n response.version = None;\n response.elapsed = 0;\n response.elapsed_headers = 0;\n response.elapsed_dns = 0;\n let persist_response = !response.request_id.is_empty();\n if persist_response {\n response = params\n .query_manager\n .connect()\n .upsert_http_response(&response, ¶ms.update_source, params.blob_manager)\n .map_err(SendHttpRequestError::PersistResponse)?;\n } else if response.id.is_empty() {\n response.id = generate_prefixed_id(\"rs\");\n }\n\n let request_body_id = format!(\"{}.request\", response.id);\n let mut request_body_capture_task = None;\n let mut request_body_capture_error = None;\n if persist_response {\n match sendable_request.body.as_mut() {\n Some(SendableBody::Bytes(bytes)) => {\n if let Err(err) = persist_request_body_bytes(\n params.blob_manager,\n &request_body_id,\n bytes.as_ref(),\n ) {\n request_body_capture_error = Some(err);\n }\n }\n Some(SendableBody::Stream { data, .. }) => {\n let (tx, rx) = tokio::sync::mpsc::unbounded_channel::>();\n let inner = std::mem::replace(data, Box::pin(tokio::io::empty()));\n let tee_reader = TeeReader::new(inner, tx);\n *data = Box::pin(tee_reader);\n let blob_manager = params.blob_manager.clone();\n let body_id = request_body_id.clone();\n request_body_capture_task = Some(tokio::spawn(async move {\n persist_request_body_stream(blob_manager, body_id, rx).await\n }));\n }\n None => {}\n }\n }\n\n let (event_tx, mut event_rx) =\n mpsc::channel::(HTTP_EVENT_CHANNEL_CAPACITY);\n let event_query_manager = params.query_manager.clone();\n let event_response_id = response.id.clone();\n let event_workspace_id = params.request.workspace_id.clone();\n let event_update_source = params.update_source.clone();\n let emit_events_to = params.emit_events_to.clone();\n let dns_elapsed = Arc::new(AtomicI32::new(0));\n let event_dns_elapsed = dns_elapsed.clone();\n let event_handle = tokio::spawn(async move {\n while let Some(event) = event_rx.recv().await {\n if let SenderHttpResponseEvent::DnsResolved { duration, .. } = &event {\n event_dns_elapsed.store(u64_to_i32(*duration), Ordering::Relaxed);\n }\n\n if persist_response {\n let db_event = HttpResponseEvent::new(\n &event_response_id,\n &event_workspace_id,\n event.clone().into(),\n );\n if let Err(err) = event_query_manager\n .connect()\n .upsert_http_response_event(&db_event, &event_update_source)\n {\n warn!(\"Failed to persist HTTP response event: {}\", err);\n }\n }\n\n if let Some(tx) = emit_events_to.as_ref() {\n let _ = tx.try_send(event);\n }\n }\n });\n\n let default_executor = DefaultSendRequestExecutor;\n let executor = params.executor.unwrap_or(&default_executor);\n let started_at = Instant::now();\n let request_started_url = sendable_request.url.clone();\n\n let mut http_response = match executor\n .send(sendable_request, event_tx, cookie_store.clone())\n .await\n {\n Ok(response) => response,\n Err(err) => {\n persist_cookie_jar(params.query_manager, cookie_jar.as_mut(), cookie_store.as_ref())?;\n if persist_response {\n let _ = persist_response_error(\n params.query_manager,\n params.blob_manager,\n ¶ms.update_source,\n &response,\n started_at,\n err.to_string(),\n request_started_url,\n );\n }\n if let Err(join_err) = event_handle.await {\n warn!(\"Failed to join response event task: {}\", join_err);\n }\n if let Some(task) = request_body_capture_task.take() {\n let _ = task.await;\n }\n return Err(SendHttpRequestError::SendRequest(err));\n }\n };\n\n let headers_elapsed = duration_to_i32(started_at.elapsed());\n std::fs::create_dir_all(params.response_dir).map_err(|source| {\n SendHttpRequestError::CreateResponseDirectory {\n path: params.response_dir.to_path_buf(),\n source,\n }\n })?;\n let body_path = params.response_dir.join(&response.id);\n let connected_response = HttpResponse {\n state: HttpResponseState::Connected,\n elapsed_headers: headers_elapsed,\n status: i32::from(http_response.status),\n status_reason: http_response.status_reason.clone(),\n url: http_response.url.clone(),\n remote_addr: http_response.remote_addr.clone(),\n version: http_response.version.clone(),\n elapsed_dns: dns_elapsed.load(Ordering::Relaxed),\n body_path: Some(body_path.to_string_lossy().to_string()),\n content_length: http_response.content_length.map(u64_to_i32),\n headers: http_response\n .headers\n .iter()\n .map(|(name, value)| HttpResponseHeader { name: name.clone(), value: value.clone() })\n .collect(),\n request_headers: http_response\n .request_headers\n .iter()\n .map(|(name, value)| HttpResponseHeader { name: name.clone(), value: value.clone() })\n .collect(),\n ..response\n };\n if persist_response {\n response = params\n .query_manager\n .connect()\n .upsert_http_response(&connected_response, ¶ms.update_source, params.blob_manager)\n .map_err(SendHttpRequestError::PersistResponse)?;\n } else {\n response = connected_response;\n }\n\n let mut file =\n File::options().create(true).truncate(true).write(true).open(&body_path).await.map_err(\n |source| SendHttpRequestError::WriteResponseBody { path: body_path.clone(), source },\n )?;\n let mut body_stream =\n http_response.into_body_stream().map_err(SendHttpRequestError::ReadResponseBody)?;\n let mut response_body = Vec::new();\n let mut body_read_error = None;\n let mut written_bytes: usize = 0;\n let mut last_progress_update = started_at;\n let mut cancelled_rx = params.cancelled_rx.clone();\n\n loop {\n let read_result = if let Some(cancelled_rx) = cancelled_rx.as_mut() {\n if *cancelled_rx.borrow() {\n break;\n }\n\n tokio::select! {\n biased;\n _ = cancelled_rx.changed() => {\n None\n }\n result = body_stream.read_buf(&mut response_body) => {\n Some(result)\n }\n }\n } else {\n Some(body_stream.read_buf(&mut response_body).await)\n };\n\n let Some(read_result) = read_result else {\n break;\n };\n\n match read_result {\n Ok(0) => break,\n Ok(n) => {\n written_bytes += n;\n let start_idx = response_body.len() - n;\n let chunk = &response_body[start_idx..];\n file.write_all(chunk).await.map_err(|source| {\n SendHttpRequestError::WriteResponseBody { path: body_path.clone(), source }\n })?;\n file.flush().await.map_err(|source| SendHttpRequestError::WriteResponseBody {\n path: body_path.clone(),\n source,\n })?;\n if let Some(tx) = params.emit_response_body_chunks_to.as_ref() {\n let _ = tx.send(chunk.to_vec());\n }\n\n let now = Instant::now();\n let should_update = now.duration_since(last_progress_update).as_millis()\n >= RESPONSE_PROGRESS_UPDATE_INTERVAL_MS;\n if should_update {\n let elapsed = duration_to_i32(started_at.elapsed());\n let progress_response = HttpResponse {\n elapsed,\n content_length: Some(usize_to_i32(written_bytes)),\n elapsed_dns: dns_elapsed.load(Ordering::Relaxed),\n ..response.clone()\n };\n if persist_response {\n response = params\n .query_manager\n .connect()\n .upsert_http_response(\n &progress_response,\n ¶ms.update_source,\n params.blob_manager,\n )\n .map_err(SendHttpRequestError::PersistResponse)?;\n } else {\n response = progress_response;\n }\n last_progress_update = now;\n }\n }\n Err(err) => {\n body_read_error = Some(SendHttpRequestError::ReadResponseBody(\n yaak_http::error::Error::BodyReadError(err.to_string()),\n ));\n break;\n }\n }\n }\n\n file.flush().await.map_err(|source| SendHttpRequestError::WriteResponseBody {\n path: body_path.clone(),\n source,\n })?;\n drop(body_stream);\n\n if let Some(task) = request_body_capture_task.take() {\n match task.await {\n Ok(Ok(total)) => {\n response.request_content_length = Some(usize_to_i32(total));\n }\n Ok(Err(err)) => request_body_capture_error = Some(err),\n Err(err) => request_body_capture_error = Some(err.to_string()),\n }\n }\n\n if let Some(err) = request_body_capture_error.take() {\n response.error = Some(append_error_message(\n response.error.take(),\n format!(\"Request succeeded but failed to store request body: {err}\"),\n ));\n }\n\n if let Err(join_err) = event_handle.await {\n warn!(\"Failed to join response event task: {}\", join_err);\n }\n\n if let Some(err) = body_read_error {\n if persist_response {\n let _ = persist_response_error(\n params.query_manager,\n params.blob_manager,\n ¶ms.update_source,\n &response,\n started_at,\n err.to_string(),\n request_started_url,\n );\n }\n persist_cookie_jar(params.query_manager, cookie_jar.as_mut(), cookie_store.as_ref())?;\n return Err(err);\n }\n\n let compressed_length = http_response.content_length.unwrap_or(written_bytes as u64);\n let final_response = HttpResponse {\n body_path: Some(body_path.to_string_lossy().to_string()),\n content_length: Some(usize_to_i32(written_bytes)),\n content_length_compressed: Some(u64_to_i32(compressed_length)),\n elapsed: duration_to_i32(started_at.elapsed()),\n elapsed_headers: headers_elapsed,\n elapsed_dns: dns_elapsed.load(Ordering::Relaxed),\n state: HttpResponseState::Closed,\n ..response\n };\n if persist_response {\n response = params\n .query_manager\n .connect()\n .upsert_http_response(&final_response, ¶ms.update_source, params.blob_manager)\n .map_err(SendHttpRequestError::PersistResponse)?;\n } else {\n response = final_response;\n }\n\n persist_cookie_jar(params.query_manager, cookie_jar.as_mut(), cookie_store.as_ref())?;\n\n Ok(SendHttpRequestResult { rendered_request, response, response_body })\n}\n\nfn persist_request_body_bytes(\n blob_manager: &BlobManager,\n body_id: &str,\n bytes: &[u8],\n) -> std::result::Result<(), String> {\n if bytes.is_empty() {\n return Ok(());\n }\n\n let blob_ctx = blob_manager.connect();\n let mut offset = 0;\n let mut chunk_index: i32 = 0;\n while offset < bytes.len() {\n let end = std::cmp::min(offset + REQUEST_BODY_CHUNK_SIZE, bytes.len());\n let chunk = BodyChunk::new(body_id, chunk_index, bytes[offset..end].to_vec());\n blob_ctx.insert_chunk(&chunk).map_err(|e| e.to_string())?;\n chunk_index += 1;\n offset = end;\n }\n Ok(())\n}\n\nasync fn persist_request_body_stream(\n blob_manager: BlobManager,\n body_id: String,\n mut rx: tokio::sync::mpsc::UnboundedReceiver>,\n) -> std::result::Result {\n let mut chunk_index: i32 = 0;\n let mut total_bytes = 0usize;\n while let Some(data) = rx.recv().await {\n total_bytes += data.len();\n if data.is_empty() {\n continue;\n }\n let chunk = BodyChunk::new(&body_id, chunk_index, data);\n blob_manager.connect().insert_chunk(&chunk).map_err(|e| e.to_string())?;\n chunk_index += 1;\n }\n\n Ok(total_bytes)\n}\n\nfn append_error_message(existing_error: Option, message: String) -> String {\n match existing_error {\n Some(existing) => format!(\"{existing}; {message}\"),\n None => message,\n }\n}\n\nfn resolve_environment_chain(\n query_manager: &QueryManager,\n request: &HttpRequest,\n environment_id: Option<&str>,\n) -> Result> {\n let db = query_manager.connect();\n db.resolve_environments(&request.workspace_id, request.folder_id.as_deref(), environment_id)\n .map_err(SendHttpRequestError::ResolveEnvironments)\n}\n\nfn resolve_inherited_request(\n query_manager: &QueryManager,\n request: &HttpRequest,\n) -> Result<(HttpRequest, String)> {\n let db = query_manager.connect();\n let (authentication_type, authentication, auth_context_id) = db\n .resolve_auth_for_http_request(request)\n .map_err(SendHttpRequestError::ResolveRequestInheritance)?;\n let resolved_headers = db\n .resolve_headers_for_http_request(request)\n .map_err(SendHttpRequestError::ResolveRequestInheritance)?;\n\n let mut request = request.clone();\n request.authentication_type = authentication_type;\n request.authentication = authentication;\n request.headers = resolved_headers;\n\n Ok((request, auth_context_id))\n}\n\nfn load_cookie_jar(\n query_manager: &QueryManager,\n cookie_jar_id: Option<&str>,\n) -> Result> {\n let Some(cookie_jar_id) = cookie_jar_id else {\n return Ok(None);\n };\n\n query_manager\n .connect()\n .get_cookie_jar(cookie_jar_id)\n .map(Some)\n .map_err(SendHttpRequestError::LoadCookieJar)\n}\n\nfn persist_cookie_jar(\n query_manager: &QueryManager,\n cookie_jar: Option<&mut CookieJar>,\n cookie_store: Option<&CookieStore>,\n) -> Result<()> {\n match (cookie_jar, cookie_store) {\n (Some(cookie_jar), Some(cookie_store)) => {\n cookie_jar.cookies = cookie_store.get_all_cookies();\n query_manager\n .connect()\n .upsert_cookie_jar(cookie_jar, &UpdateSource::Background)\n .map_err(SendHttpRequestError::PersistCookieJar)?;\n Ok(())\n }\n _ => Ok(()),\n }\n}\n\nfn proxy_setting_from_settings(proxy: Option) -> HttpConnectionProxySetting {\n match proxy {\n None => HttpConnectionProxySetting::System,\n Some(ProxySetting::Disabled) => HttpConnectionProxySetting::Disabled,\n Some(ProxySetting::Enabled { http, https, auth, bypass, disabled }) => {\n if disabled {\n HttpConnectionProxySetting::System\n } else {\n HttpConnectionProxySetting::Enabled {\n http,\n https,\n bypass,\n auth: auth.map(|ProxySettingAuth { user, password }| {\n HttpConnectionProxySettingAuth { user, password }\n }),\n }\n }\n }\n }\n}\n\npub async fn apply_plugin_authentication(\n sendable_request: &mut SendableHttpRequest,\n request: &HttpRequest,\n auth_context_id: &str,\n plugin_manager: &PluginManager,\n plugin_context: &PluginContext,\n) -> std::result::Result<(), String> {\n match &request.authentication_type {\n None => {}\n Some(authentication_type) if authentication_type == \"none\" => {}\n Some(authentication_type) => {\n let req = CallHttpAuthenticationRequest {\n context_id: format!(\"{:x}\", md5::compute(auth_context_id)),\n values: serde_json::from_value(\n serde_json::to_value(&request.authentication)\n .map_err(|e| format!(\"Failed to serialize auth values: {e}\"))?,\n )\n .map_err(|e| format!(\"Failed to parse auth values: {e}\"))?,\n url: sendable_request.url.clone(),\n method: sendable_request.method.clone(),\n headers: sendable_request\n .headers\n .iter()\n .map(|(name, value)| HttpHeader {\n name: name.to_string(),\n value: value.to_string(),\n })\n .collect(),\n };\n let plugin_result = plugin_manager\n .call_http_authentication(plugin_context, authentication_type, req)\n .await\n .map_err(|e| format!(\"Failed to apply authentication plugin: {e}\"))?;\n\n for header in plugin_result.set_headers.unwrap_or_default() {\n sendable_request.insert_header((header.name, header.value));\n }\n\n if let Some(params) = plugin_result.set_query_parameters {\n let params = params.into_iter().map(|p| (p.name, p.value)).collect::>();\n sendable_request.url = append_query_params(&sendable_request.url, params);\n }\n }\n }\n Ok(())\n}\n\nfn persist_response_error(\n query_manager: &QueryManager,\n blob_manager: &BlobManager,\n update_source: &UpdateSource,\n response: &HttpResponse,\n started_at: Instant,\n error: String,\n fallback_url: String,\n) -> Result {\n let elapsed = duration_to_i32(started_at.elapsed());\n query_manager\n .connect()\n .upsert_http_response(\n &HttpResponse {\n state: HttpResponseState::Closed,\n elapsed,\n elapsed_headers: if response.elapsed_headers == 0 {\n elapsed\n } else {\n response.elapsed_headers\n },\n error: Some(error),\n url: if response.url.is_empty() { fallback_url } else { response.url.clone() },\n ..response.clone()\n },\n update_source,\n blob_manager,\n )\n .map_err(SendHttpRequestError::PersistResponse)\n}\n\nfn sendable_body_length(body: Option<&SendableBody>) -> Option {\n match body {\n Some(SendableBody::Bytes(bytes)) => Some(usize_to_i32(bytes.len())),\n Some(SendableBody::Stream { content_length: Some(length), .. }) => {\n Some(u64_to_i32(*length))\n }\n _ => None,\n }\n}\n\nfn duration_to_i32(duration: std::time::Duration) -> i32 {\n u128_to_i32(duration.as_millis())\n}\n\nfn usize_to_i32(value: usize) -> i32 {\n if value > i32::MAX as usize { i32::MAX } else { value as i32 }\n}\n\nfn u64_to_i32(value: u64) -> i32 {\n if value > i32::MAX as u64 { i32::MAX } else { value as i32 }\n}\n\nfn u128_to_i32(value: u128) -> i32 {\n if value > i32::MAX as u128 { i32::MAX } else { value as i32 }\n}\n" }, { "path": "crates/yaak-api/Cargo.toml", "content": "[package]\nname = \"yaak-api\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nlog = { workspace = true }\nreqwest = { workspace = true, features = [\"gzip\"] }\nsysproxy = \"0.3\"\nthiserror = { workspace = true }\nyaak-common = { workspace = true }\n" }, { "path": "crates/yaak-api/src/error.rs", "content": "use thiserror::Error;\n\n#[derive(Error, Debug)]\npub enum Error {\n #[error(transparent)]\n ReqwestError(#[from] reqwest::Error),\n}\n\npub type Result = std::result::Result;\n" }, { "path": "crates/yaak-api/src/lib.rs", "content": "mod error;\n\npub use error::{Error, Result};\n\nuse log::{debug, warn};\nuse reqwest::Client;\nuse reqwest::header::{HeaderMap, HeaderValue};\nuse std::time::Duration;\nuse yaak_common::platform::{get_ua_arch, get_ua_platform};\n\n#[derive(Debug, Clone, Copy, Eq, PartialEq)]\npub enum ApiClientKind {\n App,\n Cli,\n}\n\n/// Build a reqwest Client configured for Yaak's own API calls.\n///\n/// Includes a custom User-Agent, JSON accept header, 20s timeout, gzip,\n/// and automatic OS-level proxy detection via sysproxy.\npub fn yaak_api_client(kind: ApiClientKind, version: &str) -> Result {\n let platform = get_ua_platform();\n let arch = get_ua_arch();\n let product = match kind {\n ApiClientKind::App => \"Yaak\",\n ApiClientKind::Cli => \"YaakCli\",\n };\n let ua = format!(\"{product}/{version} ({platform}; {arch})\");\n\n let mut default_headers = HeaderMap::new();\n default_headers.insert(\"Accept\", HeaderValue::from_str(\"application/json\").unwrap());\n\n let mut builder = reqwest::ClientBuilder::new()\n .timeout(Duration::from_secs(20))\n .default_headers(default_headers)\n .gzip(true)\n .user_agent(ua);\n\n if let Some(sys) = get_enabled_system_proxy() {\n let proxy_url = format!(\"http://{}:{}\", sys.host, sys.port);\n match reqwest::Proxy::all(&proxy_url) {\n Ok(p) => {\n let p = if !sys.bypass.is_empty() {\n p.no_proxy(reqwest::NoProxy::from_string(&sys.bypass))\n } else {\n p\n };\n builder = builder.proxy(p);\n }\n Err(e) => {\n warn!(\"Failed to configure system proxy: {e}\");\n }\n }\n }\n\n Ok(builder.build()?)\n}\n\n/// Returns the system proxy URL if one is enabled, e.g. `http://host:port`.\npub fn get_system_proxy_url() -> Option {\n let sys = get_enabled_system_proxy()?;\n Some(format!(\"http://{}:{}\", sys.host, sys.port))\n}\n\nfn get_enabled_system_proxy() -> Option {\n match sysproxy::Sysproxy::get_system_proxy() {\n Ok(sys) if sys.enable => {\n debug!(\"Detected system proxy: http://{}:{}\", sys.host, sys.port);\n Some(sys)\n }\n Ok(_) => {\n debug!(\"System proxy detected but not enabled\");\n None\n }\n Err(e) => {\n debug!(\"Could not detect system proxy: {e}\");\n None\n }\n }\n}\n" }, { "path": "crates/yaak-common/Cargo.toml", "content": "[package]\nname = \"yaak-common\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nserde_json = { workspace = true }\ntokio = { workspace = true, features = [\"process\"] }\n" }, { "path": "crates/yaak-common/src/command.rs", "content": "use std::ffi::{OsStr, OsString};\nuse std::io::{self, ErrorKind};\nuse std::process::Stdio;\n\n#[cfg(target_os = \"windows\")]\nconst CREATE_NO_WINDOW: u32 = 0x0800_0000;\n\n/// Creates a new `tokio::process::Command` that won't spawn a console window on Windows.\npub fn new_xplatform_command>(program: S) -> tokio::process::Command {\n #[allow(unused_mut)]\n let mut cmd = tokio::process::Command::new(program);\n #[cfg(target_os = \"windows\")]\n {\n use std::os::windows::process::CommandExt;\n cmd.creation_flags(CREATE_NO_WINDOW);\n }\n cmd\n}\n\n/// Creates a command only if the binary exists and can be invoked with the given probe argument.\npub async fn new_checked_command>(\n program: S,\n probe_arg: &str,\n) -> io::Result {\n let program: OsString = program.as_ref().to_os_string();\n\n let mut probe = new_xplatform_command(&program);\n probe.arg(probe_arg).stdin(Stdio::null()).stdout(Stdio::null()).stderr(Stdio::null());\n\n let status = probe.status().await?;\n if !status.success() {\n return Err(io::Error::new(\n ErrorKind::NotFound,\n format!(\n \"'{}' is not available on PATH or failed to execute\",\n program.to_string_lossy()\n ),\n ));\n }\n\n Ok(new_xplatform_command(&program))\n}\n" }, { "path": "crates/yaak-common/src/lib.rs", "content": "pub mod command;\npub mod platform;\npub mod serde;\n" }, { "path": "crates/yaak-common/src/platform.rs", "content": "use crate::platform::OperatingSystem::{Linux, MacOS, Unknown, Windows};\n\npub enum OperatingSystem {\n Windows,\n MacOS,\n Linux,\n Unknown,\n}\n\npub fn get_os() -> OperatingSystem {\n if cfg!(target_os = \"windows\") {\n Windows\n } else if cfg!(target_os = \"macos\") {\n MacOS\n } else if cfg!(target_os = \"linux\") {\n Linux\n } else {\n Unknown\n }\n}\n\npub fn get_os_str() -> &'static str {\n match get_os() {\n Windows => \"windows\",\n MacOS => \"macos\",\n Linux => \"linux\",\n Unknown => \"unknown\",\n }\n}\n\npub fn get_ua_platform() -> &'static str {\n if cfg!(target_os = \"windows\") {\n \"Win\"\n } else if cfg!(target_os = \"macos\") {\n \"Mac\"\n } else if cfg!(target_os = \"linux\") {\n \"Linux\"\n } else {\n \"Unknown\"\n }\n}\n\npub fn get_ua_arch() -> &'static str {\n if cfg!(target_arch = \"x86_64\") {\n \"x86_64\"\n } else if cfg!(target_arch = \"x86\") {\n \"i386\"\n } else if cfg!(target_arch = \"arm\") {\n \"ARM\"\n } else if cfg!(target_arch = \"aarch64\") {\n \"ARM64\"\n } else {\n \"Unknown\"\n }\n}\n" }, { "path": "crates/yaak-common/src/serde.rs", "content": "use serde_json::Value;\nuse std::collections::BTreeMap;\n\npub fn get_bool(v: &Value, key: &str, fallback: bool) -> bool {\n match v.get(key) {\n None => fallback,\n Some(v) => v.as_bool().unwrap_or(fallback),\n }\n}\n\npub fn get_str<'a>(v: &'a Value, key: &str) -> &'a str {\n match v.get(key) {\n None => \"\",\n Some(v) => v.as_str().unwrap_or_default(),\n }\n}\n\npub fn get_str_map<'a>(v: &'a BTreeMap, key: &str) -> &'a str {\n match v.get(key) {\n None => \"\",\n Some(v) => v.as_str().unwrap_or_default(),\n }\n}\n\npub fn get_bool_map(v: &BTreeMap, key: &str, fallback: bool) -> bool {\n match v.get(key) {\n None => fallback,\n Some(v) => v.as_bool().unwrap_or(fallback),\n }\n}\n" }, { "path": "crates/yaak-core/Cargo.toml", "content": "[package]\nname = \"yaak-core\"\nversion = \"0.0.0\"\nedition = \"2024\"\nauthors = [\"Gregory Schier\"]\npublish = false\n\n[dependencies]\nthiserror = { workspace = true }\n" }, { "path": "crates/yaak-core/src/context.rs", "content": "use std::path::PathBuf;\n\n/// Context for a workspace operation.\n///\n/// In Tauri, this is extracted from the WebviewWindow URL.\n/// In CLI, this is constructed from command arguments or config.\n#[derive(Debug, Clone, Default)]\npub struct WorkspaceContext {\n pub workspace_id: Option,\n pub environment_id: Option,\n pub cookie_jar_id: Option,\n pub request_id: Option,\n}\n\nimpl WorkspaceContext {\n pub fn new() -> Self {\n Self::default()\n }\n\n pub fn with_workspace(mut self, workspace_id: impl Into) -> Self {\n self.workspace_id = Some(workspace_id.into());\n self\n }\n\n pub fn with_environment(mut self, environment_id: impl Into) -> Self {\n self.environment_id = Some(environment_id.into());\n self\n }\n\n pub fn with_cookie_jar(mut self, cookie_jar_id: impl Into) -> Self {\n self.cookie_jar_id = Some(cookie_jar_id.into());\n self\n }\n\n pub fn with_request(mut self, request_id: impl Into) -> Self {\n self.request_id = Some(request_id.into());\n self\n }\n}\n\n/// Application context trait for accessing app-level resources.\n///\n/// This abstracts over Tauri's `AppHandle` for path resolution and app identity.\n/// Implemented by Tauri's AppHandle and by CLI's own context struct.\npub trait AppContext: Send + Sync + Clone {\n /// Returns the path to the application data directory.\n /// This is where the database and other persistent data are stored.\n fn app_data_dir(&self) -> PathBuf;\n\n /// Returns the application identifier (e.g., \"app.yaak.desktop\").\n /// Used for keyring access and other platform-specific features.\n fn app_identifier(&self) -> &str;\n\n /// Returns true if running in development mode.\n fn is_dev(&self) -> bool;\n}\n" }, { "path": "crates/yaak-core/src/error.rs", "content": "use thiserror::Error;\n\npub type Result = std::result::Result;\n\n#[derive(Error, Debug)]\npub enum Error {\n #[error(\"Missing required context: {0}\")]\n MissingContext(String),\n\n #[error(\"Configuration error: {0}\")]\n Config(String),\n\n #[error(\"IO error: {0}\")]\n Io(#[from] std::io::Error),\n}\n" }, { "path": "crates/yaak-core/src/lib.rs", "content": "//! Core abstractions for Yaak that work without Tauri.\n//!\n//! This crate provides foundational types and traits that allow Yaak's\n//! business logic to run in both Tauri (desktop app) and CLI contexts.\n\nmod context;\nmod error;\n\npub use context::{AppContext, WorkspaceContext};\npub use error::{Error, Result};\n" }, { "path": "crates/yaak-crypto/Cargo.toml", "content": "[package]\nname = \"yaak-crypto\"\nversion = \"0.1.0\"\nedition = \"2021\"\npublish = false\n\n[dependencies]\nbase32 = \"0.5.1\" # For encoding human-readable key\nbase64 = \"0.22.1\" # For encoding in the database\nchacha20poly1305 = \"0.10.1\"\nkeyring = { workspace = true, features = [\"apple-native\", \"windows-native\", \"sync-secret-service\"] }\nlog = { workspace = true }\nserde = { workspace = true, features = [\"derive\"] }\nthiserror = { workspace = true }\nyaak-models = { workspace = true }\n" }, { "path": "crates/yaak-crypto/index.ts", "content": "import { invoke } from \"@tauri-apps/api/core\";\n\nexport function enableEncryption(workspaceId: string) {\n return invoke(\"cmd_enable_encryption\", { workspaceId });\n}\n\nexport function revealWorkspaceKey(workspaceId: string) {\n return invoke(\"cmd_reveal_workspace_key\", { workspaceId });\n}\n\nexport function setWorkspaceKey(args: { workspaceId: string; key: string }) {\n return invoke(\"cmd_set_workspace_key\", args);\n}\n\nexport function disableEncryption(workspaceId: string) {\n return invoke(\"cmd_disable_encryption\", { workspaceId });\n}\n" }, { "path": "crates/yaak-crypto/package.json", "content": "{\n \"name\": \"@yaakapp-internal/crypto\",\n \"version\": \"1.0.0\",\n \"private\": true,\n \"main\": \"index.ts\"\n}\n" }, { "path": "crates/yaak-crypto/src/encryption.rs", "content": "use crate::error::Error::{DecryptionError, EncryptionError, InvalidEncryptedData};\nuse crate::error::Result;\nuse chacha20poly1305::aead::generic_array::typenum::Unsigned;\nuse chacha20poly1305::aead::{Aead, AeadCore, Key, KeyInit, OsRng};\nuse chacha20poly1305::XChaCha20Poly1305;\n\nconst ENCRYPTION_TAG: &str = \"yA4k3nC\";\nconst ENCRYPTION_VERSION: u8 = 1;\n\npub(crate) fn encrypt_data(data: &[u8], key: &Key) -> Result> {\n let nonce = XChaCha20Poly1305::generate_nonce(&mut OsRng);\n let cipher = XChaCha20Poly1305::new(&key);\n let ciphered_data = cipher.encrypt(&nonce, data).map_err(|_| EncryptionError)?;\n\n let mut data: Vec = Vec::new();\n data.extend_from_slice(ENCRYPTION_TAG.as_bytes()); // Tag\n data.push(ENCRYPTION_VERSION); // Version\n data.extend_from_slice(&nonce.as_slice()); // Nonce\n data.extend_from_slice(&ciphered_data); // Ciphertext\n\n Ok(data)\n}\n\npub(crate) fn decrypt_data(cipher_data: &[u8], key: &Key) -> Result> {\n // Yaak Tag + ID + Version + Nonce + ... ciphertext ...\n let (tag, rest) =\n cipher_data.split_at_checked(ENCRYPTION_TAG.len()).ok_or(InvalidEncryptedData)?;\n if tag != ENCRYPTION_TAG.as_bytes() {\n return Err(InvalidEncryptedData);\n }\n\n let (version, rest) = rest.split_at_checked(1).ok_or(InvalidEncryptedData)?;\n if version[0] != ENCRYPTION_VERSION {\n return Err(InvalidEncryptedData);\n }\n\n let nonce_bytes = ::NonceSize::to_usize();\n let (nonce, ciphered_data) = rest.split_at_checked(nonce_bytes).ok_or(InvalidEncryptedData)?;\n\n let cipher = XChaCha20Poly1305::new(&key);\n cipher.decrypt(nonce.into(), ciphered_data).map_err(|_e| DecryptionError)\n}\n\n#[cfg(test)]\nmod test {\n use crate::encryption::{decrypt_data, encrypt_data};\n use crate::error::Error::InvalidEncryptedData;\n use crate::error::Result;\n use chacha20poly1305::aead::OsRng;\n use chacha20poly1305::{KeyInit, XChaCha20Poly1305};\n\n #[test]\n fn test_encrypt_decrypt() -> Result<()> {\n let key = XChaCha20Poly1305::generate_key(OsRng);\n let encrypted = encrypt_data(\"hello world\".as_bytes(), &key)?;\n let decrypted = decrypt_data(encrypted.as_slice(), &key)?;\n assert_eq!(String::from_utf8(decrypted).unwrap(), \"hello world\");\n Ok(())\n }\n\n #[test]\n fn test_decrypt_empty() -> Result<()> {\n let key = XChaCha20Poly1305::generate_key(OsRng);\n let encrypted = encrypt_data(&[], &key)?;\n assert_eq!(encrypted.len(), 48);\n let decrypted = decrypt_data(encrypted.as_slice(), &key)?;\n assert_eq!(String::from_utf8(decrypted).unwrap(), \"\");\n Ok(())\n }\n\n #[test]\n fn test_decrypt_bad_version() -> Result<()> {\n let key = XChaCha20Poly1305::generate_key(OsRng);\n let mut encrypted = encrypt_data(\"hello world\".as_bytes(), &key)?;\n encrypted[7] = 0;\n let decrypted = decrypt_data(encrypted.as_slice(), &key);\n assert!(matches!(decrypted, Err(InvalidEncryptedData)));\n Ok(())\n }\n\n #[test]\n fn test_decrypt_bad_tag() -> Result<()> {\n let key = XChaCha20Poly1305::generate_key(OsRng);\n let mut encrypted = encrypt_data(\"hello world\".as_bytes(), &key)?;\n encrypted[0] = 2;\n let decrypted = decrypt_data(encrypted.as_slice(), &key);\n assert!(matches!(decrypted, Err(InvalidEncryptedData)));\n Ok(())\n }\n\n #[test]\n fn test_decrypt_unencrypted_data() -> Result<()> {\n let key = XChaCha20Poly1305::generate_key(OsRng);\n let decrypted = decrypt_data(\"123\".as_bytes(), &key);\n assert!(matches!(decrypted, Err(InvalidEncryptedData)));\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-crypto/src/error.rs", "content": "use serde::{Serialize, Serializer};\nuse std::io;\nuse thiserror::Error;\n\n#[derive(Error, Debug)]\npub enum Error {\n #[error(transparent)]\n DbError(#[from] yaak_models::error::Error),\n\n #[error(\"Keyring error: {0}\")]\n KeyringError(#[from] keyring::Error),\n\n #[error(\"Missing workspace encryption key\")]\n MissingWorkspaceKey,\n\n #[error(\"Incorrect workspace key\")]\n IncorrectWorkspaceKey,\n\n #[error(\"Failed to decrypt workspace key: {0}\")]\n WorkspaceKeyDecryptionError(String),\n\n #[error(\"Crypto IO error: {0}\")]\n IoError(#[from] io::Error),\n\n #[error(\"Failed to encrypt data\")]\n EncryptionError,\n\n #[error(\"Failed to decrypt data\")]\n DecryptionError,\n\n #[error(\"Invalid encrypted data\")]\n InvalidEncryptedData,\n\n #[error(\"Invalid key provided\")]\n InvalidHumanKey,\n\n #[error(\"Encryption error: {0}\")]\n GenericError(String),\n}\n\nimpl Serialize for Error {\n fn serialize(&self, serializer: S) -> std::result::Result\n where\n S: Serializer,\n {\n serializer.serialize_str(self.to_string().as_ref())\n }\n}\n\npub type Result = std::result::Result;\n" }, { "path": "crates/yaak-crypto/src/lib.rs", "content": "extern crate core;\n\npub mod encryption;\npub mod error;\npub mod manager;\nmod master_key;\nmod workspace_key;\n" }, { "path": "crates/yaak-crypto/src/manager.rs", "content": "use crate::error::Error::{\n GenericError, IncorrectWorkspaceKey, MissingWorkspaceKey, WorkspaceKeyDecryptionError,\n};\nuse crate::error::{Error, Result};\nuse crate::master_key::MasterKey;\nuse crate::workspace_key::WorkspaceKey;\nuse base64::prelude::BASE64_STANDARD;\nuse base64::Engine;\nuse log::{info, warn};\nuse std::collections::HashMap;\nuse std::sync::{Arc, Mutex};\nuse yaak_models::models::{EncryptedKey, Workspace, WorkspaceMeta};\nuse yaak_models::query_manager::QueryManager;\nuse yaak_models::util::{generate_id_of_length, UpdateSource};\n\nconst KEY_USER: &str = \"encryption-key\";\n\n#[derive(Debug, Clone)]\npub struct EncryptionManager {\n cached_master_key: Arc>>,\n cached_workspace_keys: Arc>>,\n query_manager: QueryManager,\n app_id: String,\n}\n\nimpl EncryptionManager {\n pub fn new(query_manager: QueryManager, app_id: impl Into) -> Self {\n Self {\n cached_master_key: Default::default(),\n cached_workspace_keys: Default::default(),\n query_manager,\n app_id: app_id.into(),\n }\n }\n\n pub fn encrypt(&self, workspace_id: &str, data: &[u8]) -> Result> {\n let workspace_secret = self.get_workspace_key(workspace_id)?;\n workspace_secret.encrypt(data)\n }\n\n pub fn decrypt(&self, workspace_id: &str, data: &[u8]) -> Result> {\n let workspace_secret = self.get_workspace_key(workspace_id)?;\n workspace_secret.decrypt(data)\n }\n\n pub fn reveal_workspace_key(&self, workspace_id: &str) -> Result {\n let key = self.get_workspace_key(workspace_id)?;\n key.to_human()\n }\n\n pub fn set_human_key(&self, workspace_id: &str, human_key: &str) -> Result {\n let wkey = WorkspaceKey::from_human(human_key)?;\n\n let workspace = self.query_manager.connect().get_workspace(workspace_id)?;\n let encryption_key_challenge = match workspace.encryption_key_challenge {\n None => return self.set_workspace_key(workspace_id, &wkey),\n Some(c) => c,\n };\n\n let encryption_key_challenge = match BASE64_STANDARD.decode(encryption_key_challenge) {\n Ok(c) => c,\n Err(_) => return Err(GenericError(\"Failed to decode workspace challenge\".to_string())),\n };\n\n if let Err(_) = wkey.decrypt(encryption_key_challenge.as_slice()) {\n return Err(IncorrectWorkspaceKey);\n };\n\n self.set_workspace_key(workspace_id, &wkey)\n }\n\n pub(crate) fn set_workspace_key(\n &self,\n workspace_id: &str,\n wkey: &WorkspaceKey,\n ) -> Result {\n info!(\"Created workspace key for {workspace_id}\");\n\n let encrypted_key = BASE64_STANDARD.encode(self.get_master_key()?.encrypt(wkey.raw_key())?);\n let encrypted_key = EncryptedKey { encrypted_key };\n let encryption_key_challenge = wkey.encrypt(generate_id_of_length(50).as_bytes())?;\n let encryption_key_challenge = Some(BASE64_STANDARD.encode(encryption_key_challenge));\n\n let workspace_meta = self.query_manager.with_tx::(|tx| {\n let workspace = tx.get_workspace(workspace_id)?;\n let workspace_meta = tx.get_or_create_workspace_meta(workspace_id)?;\n tx.upsert_workspace(\n &Workspace { encryption_key_challenge, ..workspace },\n &UpdateSource::Background,\n )?;\n\n Ok(tx.upsert_workspace_meta(\n &WorkspaceMeta { encryption_key: Some(encrypted_key.clone()), ..workspace_meta },\n &UpdateSource::Background,\n )?)\n })?;\n\n let mut cache = self.cached_workspace_keys.lock().unwrap();\n cache.insert(workspace_id.to_string(), wkey.clone());\n\n Ok(workspace_meta)\n }\n\n pub fn ensure_workspace_key(&self, workspace_id: &str) -> Result {\n let workspace_meta =\n self.query_manager.connect().get_or_create_workspace_meta(workspace_id)?;\n\n // Already exists\n if let Some(_) = workspace_meta.encryption_key {\n warn!(\"Tried to create workspace key when one already exists for {workspace_id}\");\n return Ok(workspace_meta);\n }\n\n let wkey = WorkspaceKey::create()?;\n self.set_workspace_key(workspace_id, &wkey)\n }\n\n pub fn disable_encryption(&self, workspace_id: &str) -> Result<()> {\n info!(\"Disabling encryption for {workspace_id}\");\n\n self.query_manager.with_tx::<(), Error>(|tx| {\n let workspace = tx.get_workspace(workspace_id)?;\n let workspace_meta = tx.get_or_create_workspace_meta(workspace_id)?;\n\n // Clear encryption challenge on workspace\n tx.upsert_workspace(\n &Workspace { encryption_key_challenge: None, ..workspace },\n &UpdateSource::Background,\n )?;\n\n // Clear encryption key on workspace meta\n tx.upsert_workspace_meta(\n &WorkspaceMeta { encryption_key: None, ..workspace_meta },\n &UpdateSource::Background,\n )?;\n\n Ok(())\n })?;\n\n // Remove from cache\n let mut cache = self.cached_workspace_keys.lock().unwrap();\n cache.remove(workspace_id);\n\n Ok(())\n }\n\n fn get_workspace_key(&self, workspace_id: &str) -> Result {\n {\n let cache = self.cached_workspace_keys.lock().unwrap();\n if let Some(k) = cache.get(workspace_id) {\n return Ok(k.clone());\n }\n };\n\n let db = self.query_manager.connect();\n let workspace_meta = db.get_or_create_workspace_meta(workspace_id)?;\n\n let key = match workspace_meta.encryption_key {\n None => return Err(MissingWorkspaceKey),\n Some(k) => k,\n };\n\n let mkey = self.get_master_key()?;\n let decoded_key = BASE64_STANDARD\n .decode(key.encrypted_key)\n .map_err(|e| WorkspaceKeyDecryptionError(e.to_string()))?;\n let raw_key = mkey\n .decrypt(decoded_key.as_slice())\n .map_err(|e| WorkspaceKeyDecryptionError(e.to_string()))?;\n let wkey = WorkspaceKey::from_raw_key(raw_key.as_slice());\n\n Ok(wkey)\n }\n\n fn get_master_key(&self) -> Result {\n // NOTE: This locks the key for the entire function which seems wrong, but this prevents\n // concurrent access from prompting the user for a keychain password multiple times.\n let mut master_secret = self.cached_master_key.lock().unwrap();\n if let Some(k) = master_secret.as_ref() {\n return Ok(k.to_owned());\n }\n\n let mkey = MasterKey::get_or_create(&self.app_id, KEY_USER)?;\n *master_secret = Some(mkey.clone());\n Ok(mkey)\n }\n}\n" }, { "path": "crates/yaak-crypto/src/master_key.rs", "content": "use crate::encryption::{decrypt_data, encrypt_data};\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse base32::Alphabet;\nuse chacha20poly1305::aead::{Key, KeyInit, OsRng};\nuse chacha20poly1305::XChaCha20Poly1305;\nuse keyring::{Entry, Error};\nuse log::info;\n\nconst HUMAN_PREFIX: &str = \"YKM_\";\n\n#[derive(Debug, Clone)]\npub(crate) struct MasterKey {\n key: Key,\n}\n\nimpl MasterKey {\n pub(crate) fn get_or_create(app_id: &str, user: &str) -> Result {\n let id = format!(\"{app_id}.EncryptionKey\");\n let entry = Entry::new(&id, user)?;\n\n let key = match entry.get_password() {\n Ok(encoded) => {\n let without_prefix = encoded.strip_prefix(HUMAN_PREFIX).unwrap_or(&encoded);\n let key_bytes = base32::decode(Alphabet::Crockford {}, &without_prefix)\n .ok_or(GenericError(\"Failed to decode master key\".to_string()))?;\n Key::::clone_from_slice(key_bytes.as_slice())\n }\n Err(Error::NoEntry) => {\n info!(\"Creating new master key\");\n let key = XChaCha20Poly1305::generate_key(OsRng);\n let encoded = base32::encode(Alphabet::Crockford {}, key.as_slice());\n let with_prefix = format!(\"{HUMAN_PREFIX}{encoded}\");\n entry.set_password(&with_prefix)?;\n key\n }\n Err(e) => return Err(GenericError(e.to_string())),\n };\n\n Ok(Self { key })\n }\n\n pub(crate) fn encrypt(&self, data: &[u8]) -> Result> {\n encrypt_data(data, &self.key)\n }\n\n pub(crate) fn decrypt(&self, data: &[u8]) -> Result> {\n decrypt_data(data, &self.key)\n }\n\n #[cfg(test)]\n pub(crate) fn test_key() -> Self {\n let key: Key = Key::::clone_from_slice(\n \"00000000000000000000000000000000\".as_bytes(),\n );\n Self { key }\n }\n}\n\n#[cfg(test)]\nmod tests {\n use crate::error::Result;\n use crate::master_key::MasterKey;\n\n #[test]\n fn test_master_key() -> Result<()> {\n // Test out the master key\n let mkey = MasterKey::test_key();\n let encrypted = mkey.encrypt(\"hello\".as_bytes())?;\n let decrypted = mkey.decrypt(encrypted.as_slice()).unwrap();\n assert_eq!(decrypted, \"hello\".as_bytes().to_vec());\n\n let mkey = MasterKey::test_key();\n let decrypted = mkey.decrypt(encrypted.as_slice()).unwrap();\n assert_eq!(decrypted, \"hello\".as_bytes().to_vec());\n\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-crypto/src/workspace_key.rs", "content": "use crate::encryption::{decrypt_data, encrypt_data};\nuse crate::error::Error::InvalidHumanKey;\nuse crate::error::Result;\nuse base32::Alphabet;\nuse chacha20poly1305::aead::{Key, KeyInit, OsRng};\nuse chacha20poly1305::{KeySizeUser, XChaCha20Poly1305};\n\n#[derive(Debug, Clone)]\npub struct WorkspaceKey {\n key: Key,\n}\n\nconst HUMAN_PREFIX: &str = \"YK\";\n\nimpl WorkspaceKey {\n pub(crate) fn to_human(&self) -> Result {\n let encoded = base32::encode(Alphabet::Crockford {}, self.key.as_slice());\n let with_prefix = format!(\"{HUMAN_PREFIX}{encoded}\");\n let with_separators = with_prefix\n .chars()\n .collect::>()\n .chunks(6)\n .map(|chunk| chunk.iter().collect::())\n .collect::>()\n .join(\"-\");\n Ok(with_separators)\n }\n\n #[allow(dead_code)]\n pub(crate) fn from_human(human_key: &str) -> Result {\n let without_prefix = human_key.strip_prefix(HUMAN_PREFIX).unwrap_or(human_key);\n let without_separators = without_prefix.replace(\"-\", \"\");\n let key =\n base32::decode(Alphabet::Crockford {}, &without_separators).ok_or(InvalidHumanKey)?;\n if key.len() != XChaCha20Poly1305::key_size() {\n return Err(InvalidHumanKey);\n }\n Ok(Self::from_raw_key(key.as_slice()))\n }\n\n pub(crate) fn from_raw_key(key: &[u8]) -> Self {\n Self { key: Key::::clone_from_slice(key) }\n }\n\n pub(crate) fn raw_key(&self) -> &[u8] {\n self.key.as_slice()\n }\n\n pub(crate) fn create() -> Result {\n let key = XChaCha20Poly1305::generate_key(OsRng);\n Ok(Self::from_raw_key(key.as_slice()))\n }\n\n pub(crate) fn encrypt(&self, data: &[u8]) -> Result> {\n encrypt_data(data, &self.key)\n }\n\n pub(crate) fn decrypt(&self, data: &[u8]) -> Result> {\n decrypt_data(data, &self.key)\n }\n\n #[cfg(test)]\n pub(crate) fn test_key() -> Self {\n Self::from_raw_key(\"f1a2d4b3c8e799af1456be3478a4c3f2\".as_bytes())\n }\n}\n\n#[cfg(test)]\nmod tests {\n use crate::error::Error::InvalidHumanKey;\n use crate::error::Result;\n use crate::workspace_key::WorkspaceKey;\n\n #[test]\n fn test_persisted_key() -> Result<()> {\n let key = WorkspaceKey::test_key();\n let encrypted = key.encrypt(\"hello\".as_bytes())?;\n assert_eq!(key.decrypt(encrypted.as_slice())?, \"hello\".as_bytes());\n\n Ok(())\n }\n\n #[test]\n fn test_human_format() -> Result<()> {\n let key = WorkspaceKey::test_key();\n\n let encrypted = key.encrypt(\"hello\".as_bytes())?;\n assert_eq!(key.decrypt(encrypted.as_slice())?, \"hello\".as_bytes());\n\n let human = key.to_human()?;\n assert_eq!(human, \"YKCRRP-2CK46H-H36RSR-CMVKJE-B1CRRK-8D9PC9-JK6D1Q-71GK8R-SKCRS0\");\n assert_eq!(\n WorkspaceKey::from_human(&human)?.decrypt(encrypted.as_slice())?,\n \"hello\".as_bytes()\n );\n\n Ok(())\n }\n\n #[test]\n fn test_from_human_invalid() -> Result<()> {\n assert!(matches!(\n WorkspaceKey::from_human(\n \"YKCRRP-2CK46H-H36RSR-CMVKJE-B1CRRK-8D9PC9-JK6D1Q-71GK8R-SKCRS0-H3X38D\",\n ),\n Err(InvalidHumanKey)\n ));\n\n assert!(matches!(WorkspaceKey::from_human(\"bad-key\",), Err(InvalidHumanKey)));\n assert!(matches!(WorkspaceKey::from_human(\"\",), Err(InvalidHumanKey)));\n\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-git/Cargo.toml", "content": "[package]\nname = \"yaak-git\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nchrono = { workspace = true, features = [\"serde\"] }\ngit2 = { version = \"0.20.4\", features = [\"vendored-libgit2\", \"vendored-openssl\"] }\nlog = { workspace = true }\nserde = { workspace = true, features = [\"derive\"] }\nserde_json = { workspace = true }\nserde_yaml = \"0.9.34\"\nthiserror = { workspace = true }\ntokio = { workspace = true, features = [\"io-util\"] }\nts-rs = { workspace = true, features = [\"chrono-impl\", \"serde-json-impl\"] }\nurl = \"2\"\nyaak-common = { workspace = true }\nyaak-models = { workspace = true }\nyaak-sync = { workspace = true }\n" }, { "path": "crates/yaak-git/bindings/gen_git.ts", "content": "// This file was generated by [ts-rs](https://github.com/Aleph-Alpha/ts-rs). Do not edit this file manually.\nimport type { SyncModel } from \"./gen_models\";\n\nexport type BranchDeleteResult = { \"type\": \"success\", message: string, } | { \"type\": \"not_fully_merged\" };\n\nexport type CloneResult = { \"type\": \"success\" } | { \"type\": \"cancelled\" } | { \"type\": \"needs_credentials\", url: string, error: string | null, };\n\nexport type GitAuthor = { name: string | null, email: string | null, };\n\nexport type GitCommit = { author: GitAuthor, when: string, message: string | null, };\n\nexport type GitRemote = { name: string, url: string | null, };\n\nexport type GitStatus = \"untracked\" | \"conflict\" | \"current\" | \"modified\" | \"removed\" | \"renamed\" | \"type_change\";\n\nexport type GitStatusEntry = { relaPath: string, status: GitStatus, staged: boolean, prev: SyncModel | null, next: SyncModel | null, };\n\nexport type GitStatusSummary = { path: string, headRef: string | null, headRefShorthand: string | null, entries: Array, origins: Array, localBranches: Array, remoteBranches: Array, ahead: number, behind: number, };\n\nexport type PullResult = { \"type\": \"success\", message: string, } | { \"type\": \"up_to_date\" } | { \"type\": \"needs_credentials\", url: string, error: string | null, } | { \"type\": \"diverged\", remote: string, branch: string, } | { \"type\": \"uncommitted_changes\" };\n\nexport type PushResult = { \"type\": \"success\", message: string, } | { \"type\": \"up_to_date\" } | { \"type\": \"needs_credentials\", url: string, error: string | null, };\n" }, { "path": "crates/yaak-git/bindings/gen_models.ts", "content": "// This file was generated by [ts-rs](https://github.com/Aleph-Alpha/ts-rs). Do not edit this file manually.\n\nexport type DnsOverride = { hostname: string, ipv4: Array, ipv6: Array, enabled?: boolean, };\n\nexport type Environment = { model: \"environment\", id: string, workspaceId: string, createdAt: string, updatedAt: string, name: string, public: boolean, parentModel: string, parentId: string | null, variables: Array, color: string | null, sortPriority: number, };\n\nexport type EnvironmentVariable = { enabled?: boolean, name: string, value: string, id?: string, };\n\nexport type Folder = { model: \"folder\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authentication: Record, authenticationType: string | null, description: string, headers: Array, name: string, sortPriority: number, };\n\nexport type GrpcRequest = { model: \"grpc_request\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authenticationType: string | null, authentication: Record, description: string, message: string, metadata: Array, method: string | null, name: string, service: string | null, sortPriority: number, url: string, };\n\nexport type HttpRequest = { model: \"http_request\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authentication: Record, authenticationType: string | null, body: Record, bodyType: string | null, description: string, headers: Array, method: string, name: string, sortPriority: number, url: string, urlParameters: Array, };\n\nexport type HttpRequestHeader = { enabled?: boolean, name: string, value: string, id?: string, };\n\nexport type HttpUrlParameter = { enabled?: boolean, name: string, value: string, id?: string, };\n\nexport type SyncModel = { \"type\": \"workspace\" } & Workspace | { \"type\": \"environment\" } & Environment | { \"type\": \"folder\" } & Folder | { \"type\": \"http_request\" } & HttpRequest | { \"type\": \"grpc_request\" } & GrpcRequest | { \"type\": \"websocket_request\" } & WebsocketRequest;\n\nexport type WebsocketRequest = { model: \"websocket_request\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authentication: Record, authenticationType: string | null, description: string, headers: Array, message: string, name: string, sortPriority: number, url: string, urlParameters: Array, };\n\nexport type Workspace = { model: \"workspace\", id: string, createdAt: string, updatedAt: string, authentication: Record, authenticationType: string | null, description: string, headers: Array, name: string, encryptionKeyChallenge: string | null, settingValidateCertificates: boolean, settingFollowRedirects: boolean, settingRequestTimeout: number, settingDnsOverrides: Array, };\n" }, { "path": "crates/yaak-git/index.ts", "content": "import { useQuery } from \"@tanstack/react-query\";\nimport { invoke } from \"@tauri-apps/api/core\";\nimport { createFastMutation } from \"@yaakapp/app/hooks/useFastMutation\";\nimport { queryClient } from \"@yaakapp/app/lib/queryClient\";\nimport { useMemo } from \"react\";\nimport {\n BranchDeleteResult,\n CloneResult,\n GitCommit,\n GitRemote,\n GitStatusSummary,\n PullResult,\n PushResult,\n} from \"./bindings/gen_git\";\nimport { showToast } from \"@yaakapp/app/lib/toast\";\n\nexport * from \"./bindings/gen_git\";\nexport * from \"./bindings/gen_models\";\n\nexport interface GitCredentials {\n username: string;\n password: string;\n}\n\nexport type DivergedStrategy = \"force_reset\" | \"merge\" | \"cancel\";\n\nexport type UncommittedChangesStrategy = \"reset\" | \"cancel\";\n\nexport interface GitCallbacks {\n addRemote: () => Promise;\n promptCredentials: (\n result: Extract,\n ) => Promise;\n promptDiverged: (result: Extract) => Promise;\n promptUncommittedChanges: () => Promise;\n forceSync: () => Promise;\n}\n\nconst onSuccess = () => queryClient.invalidateQueries({ queryKey: [\"git\"] });\n\nexport function useGit(dir: string, callbacks: GitCallbacks, refreshKey?: string) {\n const mutations = useMemo(() => gitMutations(dir, callbacks), [dir, callbacks]);\n const fetchAll = useQuery({\n queryKey: [\"git\", \"fetch_all\", dir, refreshKey],\n queryFn: () => invoke(\"cmd_git_fetch_all\", { dir }),\n refetchInterval: 10 * 60_000,\n });\n return [\n {\n remotes: useQuery({\n queryKey: [\"git\", \"remotes\", dir, refreshKey],\n queryFn: () => getRemotes(dir),\n placeholderData: (prev) => prev,\n }),\n log: useQuery({\n queryKey: [\"git\", \"log\", dir, refreshKey],\n queryFn: () => invoke(\"cmd_git_log\", { dir }),\n placeholderData: (prev) => prev,\n }),\n status: useQuery({\n refetchOnMount: true,\n queryKey: [\"git\", \"status\", dir, refreshKey, fetchAll.dataUpdatedAt],\n queryFn: () => invoke(\"cmd_git_status\", { dir }),\n placeholderData: (prev) => prev,\n }),\n },\n mutations,\n ] as const;\n}\n\nexport const gitMutations = (dir: string, callbacks: GitCallbacks) => {\n const push = async () => {\n const remotes = await getRemotes(dir);\n if (remotes.length === 0) {\n const remote = await callbacks.addRemote();\n if (remote == null) throw new Error(\"No remote found\");\n }\n\n const result = await invoke(\"cmd_git_push\", { dir });\n if (result.type !== \"needs_credentials\") return result;\n\n // Needs credentials, prompt for them\n const creds = await callbacks.promptCredentials(result);\n if (creds == null) throw new Error(\"Canceled\");\n\n await invoke(\"cmd_git_add_credential\", {\n remoteUrl: result.url,\n username: creds.username,\n password: creds.password,\n });\n\n // Push again\n return invoke(\"cmd_git_push\", { dir });\n };\n\n const handleError = (err: unknown) => {\n showToast({\n id: err instanceof Error ? err.message : String(err),\n message: err instanceof Error ? err.message : String(err),\n color: \"danger\",\n timeout: 5000,\n });\n };\n\n return {\n init: createFastMutation({\n mutationKey: [\"git\", \"init\"],\n mutationFn: () => invoke(\"cmd_git_initialize\", { dir }),\n onSuccess,\n }),\n add: createFastMutation({\n mutationKey: [\"git\", \"add\", dir],\n mutationFn: (args) => invoke(\"cmd_git_add\", { dir, ...args }),\n onSuccess,\n }),\n addRemote: createFastMutation({\n mutationKey: [\"git\", \"add-remote\"],\n mutationFn: (args) => invoke(\"cmd_git_add_remote\", { dir, ...args }),\n onSuccess,\n }),\n rmRemote: createFastMutation({\n mutationKey: [\"git\", \"rm-remote\", dir],\n mutationFn: (args) => invoke(\"cmd_git_rm_remote\", { dir, ...args }),\n onSuccess,\n }),\n createBranch: createFastMutation({\n mutationKey: [\"git\", \"branch\", dir],\n mutationFn: (args) => invoke(\"cmd_git_branch\", { dir, ...args }),\n onSuccess,\n }),\n mergeBranch: createFastMutation({\n mutationKey: [\"git\", \"merge\", dir],\n mutationFn: (args) => invoke(\"cmd_git_merge_branch\", { dir, ...args }),\n onSuccess,\n }),\n deleteBranch: createFastMutation<\n BranchDeleteResult,\n string,\n { branch: string; force?: boolean }\n >({\n mutationKey: [\"git\", \"delete-branch\", dir],\n mutationFn: (args) => invoke(\"cmd_git_delete_branch\", { dir, ...args }),\n onSuccess,\n }),\n deleteRemoteBranch: createFastMutation({\n mutationKey: [\"git\", \"delete-remote-branch\", dir],\n mutationFn: (args) => invoke(\"cmd_git_delete_remote_branch\", { dir, ...args }),\n onSuccess,\n }),\n renameBranch: createFastMutation({\n mutationKey: [\"git\", \"rename-branch\", dir],\n mutationFn: (args) => invoke(\"cmd_git_rename_branch\", { dir, ...args }),\n onSuccess,\n }),\n checkout: createFastMutation({\n mutationKey: [\"git\", \"checkout\", dir],\n mutationFn: (args) => invoke(\"cmd_git_checkout\", { dir, ...args }),\n onSuccess,\n }),\n commit: createFastMutation({\n mutationKey: [\"git\", \"commit\", dir],\n mutationFn: (args) => invoke(\"cmd_git_commit\", { dir, ...args }),\n onSuccess,\n }),\n commitAndPush: createFastMutation({\n mutationKey: [\"git\", \"commit_push\", dir],\n mutationFn: async (args) => {\n await invoke(\"cmd_git_commit\", { dir, ...args });\n return push();\n },\n onSuccess,\n }),\n\n push: createFastMutation({\n mutationKey: [\"git\", \"push\", dir],\n mutationFn: push,\n onSuccess,\n }),\n pull: createFastMutation({\n mutationKey: [\"git\", \"pull\", dir],\n async mutationFn() {\n const result = await invoke(\"cmd_git_pull\", { dir });\n\n if (result.type === \"needs_credentials\") {\n const creds = await callbacks.promptCredentials(result);\n if (creds == null) throw new Error(\"Canceled\");\n\n await invoke(\"cmd_git_add_credential\", {\n remoteUrl: result.url,\n username: creds.username,\n password: creds.password,\n });\n\n // Pull again after credentials\n return invoke(\"cmd_git_pull\", { dir });\n }\n\n if (result.type === \"uncommitted_changes\") {\n void callbacks\n .promptUncommittedChanges()\n .then(async (strategy) => {\n if (strategy === \"cancel\") return;\n\n await invoke(\"cmd_git_reset_changes\", { dir });\n return invoke(\"cmd_git_pull\", { dir });\n })\n .then(async () => {\n await onSuccess();\n await callbacks.forceSync();\n }, handleError);\n }\n\n if (result.type === \"diverged\") {\n void callbacks\n .promptDiverged(result)\n .then((strategy) => {\n if (strategy === \"cancel\") return;\n\n if (strategy === \"force_reset\") {\n return invoke(\"cmd_git_pull_force_reset\", {\n dir,\n remote: result.remote,\n branch: result.branch,\n });\n }\n\n return invoke(\"cmd_git_pull_merge\", {\n dir,\n remote: result.remote,\n branch: result.branch,\n });\n })\n .then(async () => {\n await onSuccess();\n await callbacks.forceSync();\n }, handleError);\n }\n\n return result;\n },\n onSuccess,\n }),\n unstage: createFastMutation({\n mutationKey: [\"git\", \"unstage\", dir],\n mutationFn: (args) => invoke(\"cmd_git_unstage\", { dir, ...args }),\n onSuccess,\n }),\n resetChanges: createFastMutation({\n mutationKey: [\"git\", \"reset-changes\", dir],\n mutationFn: () => invoke(\"cmd_git_reset_changes\", { dir }),\n onSuccess,\n }),\n } as const;\n};\n\nasync function getRemotes(dir: string) {\n return invoke(\"cmd_git_remotes\", { dir });\n}\n\n/**\n * Clone a git repository, prompting for credentials if needed.\n */\nexport async function gitClone(\n url: string,\n dir: string,\n promptCredentials: (args: {\n url: string;\n error: string | null;\n }) => Promise,\n): Promise {\n const result = await invoke(\"cmd_git_clone\", { url, dir });\n if (result.type !== \"needs_credentials\") return result;\n\n // Prompt for credentials\n const creds = await promptCredentials({ url: result.url, error: result.error });\n if (creds == null) return { type: \"cancelled\" };\n\n // Store credentials and retry\n await invoke(\"cmd_git_add_credential\", {\n remoteUrl: result.url,\n username: creds.username,\n password: creds.password,\n });\n\n return invoke(\"cmd_git_clone\", { url, dir });\n}\n" }, { "path": "crates/yaak-git/package.json", "content": "{\n \"name\": \"@yaakapp-internal/git\",\n \"version\": \"1.0.0\",\n \"private\": true,\n \"main\": \"index.ts\"\n}\n" }, { "path": "crates/yaak-git/src/add.rs", "content": "use crate::error::Result;\nuse crate::repository::open_repo;\nuse git2::IndexAddOption;\nuse log::info;\nuse std::path::Path;\n\npub fn git_add(dir: &Path, rela_path: &Path) -> Result<()> {\n let repo = open_repo(dir)?;\n let mut index = repo.index()?;\n\n info!(\"Staging file {rela_path:?} to {dir:?}\");\n index.add_all(&[rela_path], IndexAddOption::DEFAULT, None)?;\n index.write()?;\n\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/binary.rs", "content": "use crate::error::Error::GitNotFound;\nuse crate::error::Result;\nuse std::path::Path;\nuse tokio::process::Command;\nuse yaak_common::command::new_checked_command;\n\n/// Create a git command that runs in the specified directory\npub(crate) async fn new_binary_command(dir: &Path) -> Result {\n let mut cmd = new_binary_command_global().await?;\n cmd.arg(\"-C\").arg(dir);\n Ok(cmd)\n}\n\n/// Create a git command without a specific directory (for global operations)\npub(crate) async fn new_binary_command_global() -> Result {\n new_checked_command(\"git\", \"--version\").await.map_err(|_| GitNotFound)\n}\n" }, { "path": "crates/yaak-git/src/branch.rs", "content": "use serde::{Deserialize, Serialize};\nuse ts_rs::TS;\n\nuse crate::binary::new_binary_command;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse std::path::Path;\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\", tag = \"type\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub enum BranchDeleteResult {\n Success { message: String },\n NotFullyMerged,\n}\n\npub async fn git_checkout_branch(dir: &Path, branch_name: &str, force: bool) -> Result {\n let branch_name = branch_name.trim_start_matches(\"origin/\");\n\n let mut args = vec![\"checkout\"];\n if force {\n args.push(\"--force\");\n }\n args.push(branch_name);\n\n let out = new_binary_command(dir)\n .await?\n .args(&args)\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git checkout: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n\n if !out.status.success() {\n return Err(GenericError(format!(\"Failed to checkout: {}\", combined.trim())));\n }\n\n Ok(branch_name.to_string())\n}\n\npub async fn git_create_branch(dir: &Path, name: &str, base: Option<&str>) -> Result<()> {\n let mut cmd = new_binary_command(dir).await?;\n cmd.arg(\"branch\").arg(name);\n if let Some(base_branch) = base {\n cmd.arg(base_branch);\n }\n\n let out =\n cmd.output().await.map_err(|e| GenericError(format!(\"failed to run git branch: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n\n if !out.status.success() {\n return Err(GenericError(format!(\"Failed to create branch: {}\", combined.trim())));\n }\n\n Ok(())\n}\n\npub async fn git_delete_branch(dir: &Path, name: &str, force: bool) -> Result {\n let mut cmd = new_binary_command(dir).await?;\n\n let out =\n if force { cmd.args([\"branch\", \"-D\", name]) } else { cmd.args([\"branch\", \"-d\", name]) }\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git branch -d: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n\n if !out.status.success() && stderr.to_lowercase().contains(\"not fully merged\") {\n return Ok(BranchDeleteResult::NotFullyMerged);\n }\n\n if !out.status.success() {\n return Err(GenericError(format!(\"Failed to delete branch: {}\", combined.trim())));\n }\n\n Ok(BranchDeleteResult::Success { message: combined })\n}\n\npub async fn git_merge_branch(dir: &Path, name: &str) -> Result<()> {\n let out = new_binary_command(dir)\n .await?\n .args([\"merge\", name])\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git merge: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n\n if !out.status.success() {\n // Check for merge conflicts\n if combined.to_lowercase().contains(\"conflict\") {\n return Err(GenericError(\n \"Merge conflicts detected. Please resolve them manually.\".to_string(),\n ));\n }\n return Err(GenericError(format!(\"Failed to merge: {}\", combined.trim())));\n }\n\n Ok(())\n}\n\npub async fn git_delete_remote_branch(dir: &Path, name: &str) -> Result<()> {\n // Remote branch names come in as \"origin/branch-name\", extract the branch name\n let branch_name = name.trim_start_matches(\"origin/\");\n\n let out = new_binary_command(dir)\n .await?\n .args([\"push\", \"origin\", \"--delete\", branch_name])\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git push --delete: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n\n if !out.status.success() {\n return Err(GenericError(format!(\"Failed to delete remote branch: {}\", combined.trim())));\n }\n\n Ok(())\n}\n\npub async fn git_rename_branch(dir: &Path, old_name: &str, new_name: &str) -> Result<()> {\n let out = new_binary_command(dir)\n .await?\n .args([\"branch\", \"-m\", old_name, new_name])\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git branch -m: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n\n if !out.status.success() {\n return Err(GenericError(format!(\"Failed to rename branch: {}\", combined.trim())));\n }\n\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/clone.rs", "content": "use crate::binary::new_binary_command;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse log::info;\nuse serde::{Deserialize, Serialize};\nuse std::fs;\nuse std::path::Path;\nuse ts_rs::TS;\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\", tag = \"type\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub enum CloneResult {\n Success,\n Cancelled,\n NeedsCredentials { url: String, error: Option },\n}\n\npub async fn git_clone(url: &str, dir: &Path) -> Result {\n let parent = dir.parent().ok_or_else(|| GenericError(\"Invalid clone directory\".to_string()))?;\n fs::create_dir_all(parent)\n .map_err(|e| GenericError(format!(\"Failed to create directory: {e}\")))?;\n let mut cmd = new_binary_command(parent).await?;\n cmd.args([\"clone\", url]).arg(dir).env(\"GIT_TERMINAL_PROMPT\", \"0\");\n\n let out =\n cmd.output().await.map_err(|e| GenericError(format!(\"failed to run git clone: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n let combined_lower = combined.to_lowercase();\n\n info!(\"Cloned status={}: {combined}\", out.status);\n\n if !out.status.success() {\n // Check for credentials error\n if combined_lower.contains(\"could not read\") {\n return Ok(CloneResult::NeedsCredentials { url: url.to_string(), error: None });\n }\n if combined_lower.contains(\"unable to access\")\n || combined_lower.contains(\"authentication failed\")\n {\n return Ok(CloneResult::NeedsCredentials {\n url: url.to_string(),\n error: Some(combined.to_string()),\n });\n }\n return Err(GenericError(format!(\"Failed to clone: {}\", combined.trim())));\n }\n\n Ok(CloneResult::Success)\n}\n" }, { "path": "crates/yaak-git/src/commit.rs", "content": "use crate::binary::new_binary_command;\nuse crate::error::Error::GenericError;\nuse log::info;\nuse std::path::Path;\n\npub async fn git_commit(dir: &Path, message: &str) -> crate::error::Result<()> {\n let out =\n new_binary_command(dir).await?.args([\"commit\", \"--message\", message]).output().await?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = stdout + stderr;\n\n if !out.status.success() {\n return Err(GenericError(format!(\"Failed to commit: {}\", combined)));\n }\n\n info!(\"Committed to {dir:?}\");\n\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/credential.rs", "content": "use crate::binary::new_binary_command_global;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse std::process::Stdio;\nuse tokio::io::AsyncWriteExt;\nuse url::Url;\n\npub async fn git_add_credential(remote_url: &str, username: &str, password: &str) -> Result<()> {\n let url = Url::parse(remote_url)\n .map_err(|e| GenericError(format!(\"Failed to parse remote url {remote_url}: {e:?}\")))?;\n let protocol = url.scheme();\n let host = url.host_str().unwrap();\n let path = Some(url.path());\n\n let mut child = new_binary_command_global()\n .await?\n .args([\"credential\", \"approve\"])\n .stdin(Stdio::piped())\n .stdout(Stdio::null())\n .spawn()?;\n\n {\n let stdin = child.stdin.as_mut().unwrap();\n stdin.write_all(format!(\"protocol={}\\n\", protocol).as_bytes()).await?;\n stdin.write_all(format!(\"host={}\\n\", host).as_bytes()).await?;\n if let Some(path) = path {\n if !path.is_empty() {\n stdin\n .write_all(format!(\"path={}\\n\", path.trim_start_matches('/')).as_bytes())\n .await?;\n }\n }\n stdin.write_all(format!(\"username={}\\n\", username).as_bytes()).await?;\n stdin.write_all(format!(\"password={}\\n\", password).as_bytes()).await?;\n stdin.write_all(b\"\\n\").await?; // blank line terminator\n }\n\n let status = child.wait().await?;\n if !status.success() {\n return Err(GenericError(\"Failed to approve git credential\".to_string()));\n }\n\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/error.rs", "content": "use serde::{Serialize, Serializer};\nuse std::io;\nuse std::path::PathBuf;\nuse std::string::FromUtf8Error;\nuse thiserror::Error;\n\n#[derive(Error, Debug)]\npub enum Error {\n #[error(\"Git repo not found {0}\")]\n GitRepoNotFound(PathBuf),\n\n #[error(\"Git error: {0}\")]\n GitUnknown(#[from] git2::Error),\n\n #[error(\"Yaml error: {0}\")]\n YamlParseError(#[from] serde_yaml::Error),\n\n #[error(transparent)]\n ModelError(#[from] yaak_models::error::Error),\n\n #[error(\"Sync error: {0}\")]\n SyncError(#[from] yaak_sync::error::Error),\n\n #[error(\"I/o error: {0}\")]\n IoError(#[from] io::Error),\n\n #[error(\"JSON error: {0}\")]\n JsonParseError(#[from] serde_json::Error),\n\n #[error(\"UTF8 error: {0}\")]\n Utf8ConversionError(#[from] FromUtf8Error),\n\n #[error(\"Git error: {0}\")]\n GenericError(String),\n\n #[error(\"'git' not found. Please ensure it's installed and available in $PATH\")]\n GitNotFound,\n\n #[error(\"Credentials required: {0}\")]\n CredentialsRequiredError(String),\n\n #[error(\"No default remote found\")]\n NoDefaultRemoteFound,\n\n #[error(\"No remotes found for repo\")]\n NoRemotesFound,\n\n #[error(\"Merge failed due to conflicts\")]\n MergeConflicts,\n\n #[error(\"No active branch\")]\n NoActiveBranch,\n}\n\nimpl Serialize for Error {\n fn serialize(&self, serializer: S) -> std::result::Result\n where\n S: Serializer,\n {\n serializer.serialize_str(self.to_string().as_ref())\n }\n}\n\npub type Result = std::result::Result;\n" }, { "path": "crates/yaak-git/src/fetch.rs", "content": "use crate::binary::new_binary_command;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse std::path::Path;\n\npub async fn git_fetch_all(dir: &Path) -> Result<()> {\n let out = new_binary_command(dir)\n .await?\n .args([\"fetch\", \"--all\", \"--prune\", \"--tags\"])\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git pull: {e}\")))?;\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = stdout + stderr;\n\n if !out.status.success() {\n return Err(GenericError(format!(\"Failed to fetch: {}\", combined)));\n }\n\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/init.rs", "content": "use crate::error::Result;\nuse crate::repository::open_repo;\nuse log::info;\nuse std::path::Path;\n\npub fn git_init(dir: &Path) -> Result<()> {\n git2::Repository::init(dir)?;\n let repo = open_repo(dir)?;\n // Default to main instead of master, to align with\n // the official Git and GitHub behavior\n repo.set_head(\"refs/heads/main\")?;\n info!(\"Initialized {dir:?}\");\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/lib.rs", "content": "mod add;\nmod binary;\nmod branch;\nmod clone;\nmod commit;\nmod credential;\npub mod error;\nmod fetch;\nmod init;\nmod log;\n\nmod pull;\nmod push;\nmod remotes;\nmod repository;\nmod reset;\nmod status;\nmod unstage;\nmod util;\n\n// Re-export all git functions for external use\npub use add::git_add;\npub use branch::{\n BranchDeleteResult, git_checkout_branch, git_create_branch, git_delete_branch,\n git_delete_remote_branch, git_merge_branch, git_rename_branch,\n};\npub use clone::{CloneResult, git_clone};\npub use commit::git_commit;\npub use credential::git_add_credential;\npub use fetch::git_fetch_all;\npub use init::git_init;\npub use log::{GitCommit, git_log};\npub use pull::{PullResult, git_pull, git_pull_force_reset, git_pull_merge};\npub use push::{PushResult, git_push};\npub use remotes::{GitRemote, git_add_remote, git_remotes, git_rm_remote};\npub use reset::git_reset_changes;\npub use status::{GitStatusSummary, git_status};\npub use unstage::git_unstage;\n" }, { "path": "crates/yaak-git/src/log.rs", "content": "use crate::repository::open_repo;\nuse chrono::{DateTime, Utc};\nuse serde::{Deserialize, Serialize};\nuse std::path::Path;\nuse ts_rs::TS;\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub struct GitCommit {\n pub author: GitAuthor,\n pub when: DateTime,\n pub message: Option,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub struct GitAuthor {\n pub name: Option,\n pub email: Option,\n}\n\npub fn git_log(dir: &Path) -> crate::error::Result> {\n let repo = open_repo(dir)?;\n\n // Return empty if empty repo or no head (new repo)\n if repo.is_empty()? || repo.head().is_err() {\n return Ok(vec![]);\n }\n\n let mut revwalk = repo.revwalk()?;\n revwalk.push_head()?;\n revwalk.set_sorting(git2::Sort::TIME)?;\n\n // Run git log\n macro_rules! filter_try {\n ($e:expr) => {\n match $e {\n Ok(t) => t,\n Err(_) => return None,\n }\n };\n }\n let log: Vec = revwalk\n .filter_map(|oid| {\n let oid = filter_try!(oid);\n let commit = filter_try!(repo.find_commit(oid));\n let author = commit.author();\n Some(GitCommit {\n author: GitAuthor {\n name: author.name().map(|s| s.to_string()),\n email: author.email().map(|s| s.to_string()),\n },\n when: convert_git_time_to_date(author.when()),\n message: commit.message().map(|m| m.to_string()),\n })\n })\n .collect();\n\n Ok(log)\n}\n\n#[cfg(test)]\nfn convert_git_time_to_date(_git_time: git2::Time) -> DateTime {\n DateTime::from_timestamp(0, 0).unwrap()\n}\n\n#[cfg(not(test))]\nfn convert_git_time_to_date(git_time: git2::Time) -> DateTime {\n let timestamp = git_time.seconds();\n DateTime::from_timestamp(timestamp, 0).unwrap()\n}\n" }, { "path": "crates/yaak-git/src/pull.rs", "content": "use crate::binary::new_binary_command;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse crate::repository::open_repo;\nuse crate::util::{get_current_branch_name, get_default_remote_in_repo};\nuse log::info;\nuse serde::{Deserialize, Serialize};\nuse std::path::Path;\nuse ts_rs::TS;\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\", tag = \"type\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub enum PullResult {\n Success { message: String },\n UpToDate,\n NeedsCredentials { url: String, error: Option },\n Diverged { remote: String, branch: String },\n UncommittedChanges,\n}\n\nfn has_uncommitted_changes(dir: &Path) -> Result {\n let repo = open_repo(dir)?;\n let mut opts = git2::StatusOptions::new();\n opts.include_ignored(false).include_untracked(false);\n let statuses = repo.statuses(Some(&mut opts))?;\n Ok(statuses.iter().any(|e| e.status() != git2::Status::CURRENT))\n}\n\npub async fn git_pull(dir: &Path) -> Result {\n if has_uncommitted_changes(dir)? {\n return Ok(PullResult::UncommittedChanges);\n }\n\n // Extract all git2 data before any await points (git2 types are not Send)\n let (branch_name, remote_name, remote_url) = {\n let repo = open_repo(dir)?;\n let branch_name = get_current_branch_name(&repo)?;\n let remote = get_default_remote_in_repo(&repo)?;\n let remote_name =\n remote.name().ok_or(GenericError(\"Failed to get remote name\".to_string()))?.to_string();\n let remote_url =\n remote.url().ok_or(GenericError(\"Failed to get remote url\".to_string()))?.to_string();\n (branch_name, remote_name, remote_url)\n };\n\n // Step 1: fetch the specific branch\n // NOTE: We use fetch + merge instead of `git pull` to avoid conflicts with\n // global git config (e.g. pull.ff=only) and the background fetch --all.\n let fetch_out = new_binary_command(dir)\n .await?\n .args([\"fetch\", &remote_name, &branch_name])\n .env(\"GIT_TERMINAL_PROMPT\", \"0\")\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git fetch: {e}\")))?;\n\n let fetch_stdout = String::from_utf8_lossy(&fetch_out.stdout);\n let fetch_stderr = String::from_utf8_lossy(&fetch_out.stderr);\n let fetch_combined = format!(\"{fetch_stdout}{fetch_stderr}\");\n\n info!(\"Fetched status={} {fetch_combined}\", fetch_out.status);\n\n if fetch_combined.to_lowercase().contains(\"could not read\") {\n return Ok(PullResult::NeedsCredentials { url: remote_url.to_string(), error: None });\n }\n\n if fetch_combined.to_lowercase().contains(\"unable to access\") {\n return Ok(PullResult::NeedsCredentials {\n url: remote_url.to_string(),\n error: Some(fetch_combined.to_string()),\n });\n }\n\n if !fetch_out.status.success() {\n return Err(GenericError(format!(\"Failed to fetch: {fetch_combined}\")));\n }\n\n // Step 2: merge the fetched branch\n let ref_name = format!(\"{}/{}\", remote_name, branch_name);\n let merge_out = new_binary_command(dir)\n .await?\n .args([\"merge\", \"--ff-only\", &ref_name])\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git merge: {e}\")))?;\n\n let merge_stdout = String::from_utf8_lossy(&merge_out.stdout);\n let merge_stderr = String::from_utf8_lossy(&merge_out.stderr);\n let merge_combined = format!(\"{merge_stdout}{merge_stderr}\");\n\n info!(\"Merged status={} {merge_combined}\", merge_out.status);\n\n if !merge_out.status.success() {\n let merge_lower = merge_combined.to_lowercase();\n if merge_lower.contains(\"cannot fast-forward\")\n || merge_lower.contains(\"not possible to fast-forward\")\n || merge_lower.contains(\"diverged\")\n {\n return Ok(PullResult::Diverged { remote: remote_name, branch: branch_name });\n }\n return Err(GenericError(format!(\"Failed to merge: {merge_combined}\")));\n }\n\n if merge_combined.to_lowercase().contains(\"up to date\") {\n return Ok(PullResult::UpToDate);\n }\n\n Ok(PullResult::Success { message: format!(\"Pulled from {}/{}\", remote_name, branch_name) })\n}\n\npub async fn git_pull_force_reset(dir: &Path, remote: &str, branch: &str) -> Result {\n // Step 1: fetch the remote\n let fetch_out = new_binary_command(dir)\n .await?\n .args([\"fetch\", remote])\n .env(\"GIT_TERMINAL_PROMPT\", \"0\")\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git fetch: {e}\")))?;\n\n if !fetch_out.status.success() {\n let stderr = String::from_utf8_lossy(&fetch_out.stderr);\n return Err(GenericError(format!(\"Failed to fetch: {stderr}\")));\n }\n\n // Step 2: reset --hard to remote/branch\n let ref_name = format!(\"{}/{}\", remote, branch);\n let reset_out = new_binary_command(dir)\n .await?\n .args([\"reset\", \"--hard\", &ref_name])\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git reset: {e}\")))?;\n\n if !reset_out.status.success() {\n let stderr = String::from_utf8_lossy(&reset_out.stderr);\n return Err(GenericError(format!(\"Failed to reset: {}\", stderr.trim())));\n }\n\n Ok(PullResult::Success { message: format!(\"Reset to {}/{}\", remote, branch) })\n}\n\npub async fn git_pull_merge(dir: &Path, remote: &str, branch: &str) -> Result {\n let out = new_binary_command(dir)\n .await?\n .args([\"pull\", \"--no-rebase\", remote, branch])\n .env(\"GIT_TERMINAL_PROMPT\", \"0\")\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git pull --no-rebase: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = format!(\"{}{}\", stdout, stderr);\n\n info!(\"Pull merge status={} {combined}\", out.status);\n\n if !out.status.success() {\n if combined.to_lowercase().contains(\"conflict\") {\n return Err(GenericError(\n \"Merge conflicts detected. Please resolve them manually.\".to_string(),\n ));\n }\n return Err(GenericError(format!(\"Failed to merge pull: {}\", combined.trim())));\n }\n\n Ok(PullResult::Success { message: format!(\"Merged from {}/{}\", remote, branch) })\n}\n\n// pub(crate) fn git_pull_old(dir: &Path) -> Result {\n// let repo = open_repo(dir)?;\n//\n// let branch = get_current_branch(&repo)?.ok_or(NoActiveBranch)?;\n// let branch_ref = branch.get();\n// let branch_ref = bytes_to_string(branch_ref.name_bytes())?;\n//\n// let remote_name = repo.branch_upstream_remote(&branch_ref)?;\n// let remote_name = bytes_to_string(&remote_name)?;\n// debug!(\"Pulling from {remote_name}\");\n//\n// let mut remote = repo.find_remote(&remote_name)?;\n//\n// let mut options = FetchOptions::new();\n// let callbacks = default_callbacks();\n// options.remote_callbacks(callbacks);\n//\n// let mut proxy = ProxyOptions::new();\n// proxy.auto();\n// options.proxy_options(proxy);\n//\n// remote.fetch(&[&branch_ref], Some(&mut options), None)?;\n//\n// let stats = remote.stats();\n//\n// let fetch_head = repo.find_reference(\"FETCH_HEAD\")?;\n// let fetch_commit = repo.reference_to_annotated_commit(&fetch_head)?;\n// do_merge(&repo, &branch, &fetch_commit)?;\n//\n// Ok(PullResult::Success {\n// message: \"Hello\".to_string(),\n// // received_bytes: stats.received_bytes(),\n// // received_objects: stats.received_objects(),\n// })\n// }\n" }, { "path": "crates/yaak-git/src/push.rs", "content": "use crate::binary::new_binary_command;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse crate::repository::open_repo;\nuse crate::util::{get_current_branch_name, get_default_remote_for_push_in_repo};\nuse log::info;\nuse serde::{Deserialize, Serialize};\nuse std::path::Path;\nuse ts_rs::TS;\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\", tag = \"type\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub enum PushResult {\n Success { message: String },\n UpToDate,\n NeedsCredentials { url: String, error: Option },\n}\n\npub async fn git_push(dir: &Path) -> Result {\n // Extract all git2 data before any await points (git2 types are not Send)\n let (branch_name, remote_name, remote_url) = {\n let repo = open_repo(dir)?;\n let branch_name = get_current_branch_name(&repo)?;\n let remote = get_default_remote_for_push_in_repo(&repo)?;\n let remote_name =\n remote.name().ok_or(GenericError(\"Failed to get remote name\".to_string()))?.to_string();\n let remote_url =\n remote.url().ok_or(GenericError(\"Failed to get remote url\".to_string()))?.to_string();\n (branch_name, remote_name, remote_url)\n };\n\n let out = new_binary_command(dir)\n .await?\n .args([\"push\", &remote_name, &branch_name])\n .env(\"GIT_TERMINAL_PROMPT\", \"0\")\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git push: {e}\")))?;\n\n let stdout = String::from_utf8_lossy(&out.stdout);\n let stderr = String::from_utf8_lossy(&out.stderr);\n let combined = stdout + stderr;\n let combined_lower = combined.to_lowercase();\n\n info!(\"Pushed to repo status={} {combined}\", out.status);\n\n // Helper to check if this is a credentials error\n let is_credentials_error = || {\n combined_lower.contains(\"could not read\")\n || combined_lower.contains(\"unable to access\")\n || combined_lower.contains(\"authentication failed\")\n };\n\n // Check for explicit rejection indicators first (e.g., protected branch rejections)\n // These can occur even if some git servers don't properly set exit codes\n if combined_lower.contains(\"rejected\") || combined_lower.contains(\"failed to push\") {\n if is_credentials_error() {\n return Ok(PushResult::NeedsCredentials {\n url: remote_url.to_string(),\n error: Some(combined.to_string()),\n });\n }\n return Err(GenericError(format!(\"Failed to push: {combined}\")));\n }\n\n // Check exit status for any other failures\n if !out.status.success() {\n if combined_lower.contains(\"could not read\") {\n return Ok(PushResult::NeedsCredentials { url: remote_url.to_string(), error: None });\n }\n if combined_lower.contains(\"unable to access\")\n || combined_lower.contains(\"authentication failed\")\n {\n return Ok(PushResult::NeedsCredentials {\n url: remote_url.to_string(),\n error: Some(combined.to_string()),\n });\n }\n return Err(GenericError(format!(\"Failed to push: {combined}\")));\n }\n\n // Success cases (exit code 0 and no rejection indicators)\n if combined_lower.contains(\"up-to-date\") {\n return Ok(PushResult::UpToDate);\n }\n\n Ok(PushResult::Success { message: format!(\"Pushed to {}/{}\", remote_name, branch_name) })\n}\n" }, { "path": "crates/yaak-git/src/remotes.rs", "content": "use crate::error::Result;\nuse crate::repository::open_repo;\nuse log::warn;\nuse serde::{Deserialize, Serialize};\nuse std::path::Path;\nuse ts_rs::TS;\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[ts(export, export_to = \"gen_git.ts\")]\npub struct GitRemote {\n name: String,\n url: Option,\n}\n\npub fn git_remotes(dir: &Path) -> Result> {\n let repo = open_repo(dir)?;\n let mut remotes = Vec::new();\n\n for remote in repo.remotes()?.into_iter() {\n let name = match remote {\n None => continue,\n Some(name) => name,\n };\n let r = match repo.find_remote(name) {\n Ok(r) => r,\n Err(e) => {\n warn!(\"Failed to get remote {name}: {e:?}\");\n continue;\n }\n };\n remotes.push(GitRemote { name: name.to_string(), url: r.url().map(|u| u.to_string()) });\n }\n\n Ok(remotes)\n}\n\npub fn git_add_remote(dir: &Path, name: &str, url: &str) -> Result {\n let repo = open_repo(dir)?;\n repo.remote(name, url)?;\n Ok(GitRemote { name: name.to_string(), url: Some(url.to_string()) })\n}\n\npub fn git_rm_remote(dir: &Path, name: &str) -> Result<()> {\n let repo = open_repo(dir)?;\n repo.remote_delete(name)?;\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/repository.rs", "content": "use crate::error::Error::{GitRepoNotFound, GitUnknown};\nuse std::path::Path;\n\npub(crate) fn open_repo(dir: &Path) -> crate::error::Result {\n match git2::Repository::discover(dir) {\n Ok(r) => Ok(r),\n Err(e) if e.code() == git2::ErrorCode::NotFound => Err(GitRepoNotFound(dir.to_path_buf())),\n Err(e) => Err(GitUnknown(e)),\n }\n}\n" }, { "path": "crates/yaak-git/src/reset.rs", "content": "use crate::binary::new_binary_command;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse std::path::Path;\n\npub async fn git_reset_changes(dir: &Path) -> Result<()> {\n let out = new_binary_command(dir)\n .await?\n .args([\"reset\", \"--hard\", \"HEAD\"])\n .output()\n .await\n .map_err(|e| GenericError(format!(\"failed to run git reset: {e}\")))?;\n\n if !out.status.success() {\n let stderr = String::from_utf8_lossy(&out.stderr);\n return Err(GenericError(format!(\"Failed to reset: {}\", stderr.trim())));\n }\n\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/status.rs", "content": "use crate::repository::open_repo;\nuse crate::util::{local_branch_names, remote_branch_names};\nuse log::warn;\nuse serde::{Deserialize, Serialize};\nuse std::fs;\nuse std::path::Path;\nuse ts_rs::TS;\nuse yaak_sync::models::SyncModel;\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS, PartialEq)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub struct GitStatusSummary {\n pub path: String,\n pub head_ref: Option,\n pub head_ref_shorthand: Option,\n pub entries: Vec,\n pub origins: Vec,\n pub local_branches: Vec,\n pub remote_branches: Vec,\n pub ahead: u32,\n pub behind: u32,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub struct GitStatusEntry {\n pub rela_path: String,\n pub status: GitStatus,\n pub staged: bool,\n pub prev: Option,\n pub next: Option,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_git.ts\")]\npub enum GitStatus {\n Untracked,\n Conflict,\n Current,\n Modified,\n Removed,\n Renamed,\n TypeChange,\n}\n\npub fn git_status(dir: &Path) -> crate::error::Result {\n let repo = open_repo(dir)?;\n let (head_tree, head_ref, head_ref_shorthand) = match repo.head() {\n Ok(head) => {\n let tree = head.peel_to_tree().ok();\n let head_ref_shorthand = head.shorthand().map(|s| s.to_string());\n let head_ref = head.name().map(|s| s.to_string());\n\n (tree, head_ref, head_ref_shorthand)\n }\n Err(_) => {\n // For \"unborn\" repos, reading from HEAD is the only way to get the branch name\n // See https://github.com/starship/starship/pull/1336\n let head_path = repo.path().join(\"HEAD\");\n let head_ref = fs::read_to_string(&head_path)\n .ok()\n .unwrap_or_default()\n .lines()\n .next()\n .map(|s| s.trim_start_matches(\"ref:\").trim().to_string());\n let head_ref_shorthand =\n head_ref.clone().map(|r| r.split('/').last().unwrap_or(\"unknown\").to_string());\n (None, head_ref, head_ref_shorthand)\n }\n };\n\n let mut opts = git2::StatusOptions::new();\n opts.include_ignored(false)\n .include_untracked(true) // Include untracked\n .recurse_untracked_dirs(true) // Show all untracked\n .include_unmodified(true); // Include unchanged\n\n // TODO: Support renames\n\n let mut entries: Vec = Vec::new();\n for entry in repo.statuses(Some(&mut opts))?.into_iter() {\n let rela_path = entry.path().unwrap().to_string();\n let status = entry.status();\n let index_status = match status {\n // Note: order matters here, since we're checking a bitmap!\n s if s.contains(git2::Status::CONFLICTED) => GitStatus::Conflict,\n s if s.contains(git2::Status::INDEX_NEW) => GitStatus::Untracked,\n s if s.contains(git2::Status::INDEX_MODIFIED) => GitStatus::Modified,\n s if s.contains(git2::Status::INDEX_DELETED) => GitStatus::Removed,\n s if s.contains(git2::Status::INDEX_RENAMED) => GitStatus::Renamed,\n s if s.contains(git2::Status::INDEX_TYPECHANGE) => GitStatus::TypeChange,\n s if s.contains(git2::Status::CURRENT) => GitStatus::Current,\n s => {\n warn!(\"Unknown index status {s:?}\");\n continue;\n }\n };\n\n let worktree_status = match status {\n // Note: order matters here, since we're checking a bitmap!\n s if s.contains(git2::Status::CONFLICTED) => GitStatus::Conflict,\n s if s.contains(git2::Status::WT_NEW) => GitStatus::Untracked,\n s if s.contains(git2::Status::WT_MODIFIED) => GitStatus::Modified,\n s if s.contains(git2::Status::WT_DELETED) => GitStatus::Removed,\n s if s.contains(git2::Status::WT_RENAMED) => GitStatus::Renamed,\n s if s.contains(git2::Status::WT_TYPECHANGE) => GitStatus::TypeChange,\n s if s.contains(git2::Status::CURRENT) => GitStatus::Current,\n s => {\n warn!(\"Unknown worktree status {s:?}\");\n continue;\n }\n };\n\n let status = if index_status == GitStatus::Current {\n worktree_status.clone()\n } else {\n index_status.clone()\n };\n\n let staged = if index_status == GitStatus::Current && worktree_status == GitStatus::Current\n {\n // No change, so can't be added\n false\n } else if index_status != GitStatus::Current {\n true\n } else {\n false\n };\n\n // Get previous content from Git, if it's in there\n let prev = match head_tree.clone() {\n None => None,\n Some(t) => match t.get_path(&Path::new(&rela_path)) {\n Ok(entry) => {\n let obj = entry.to_object(&repo)?;\n let content = obj.as_blob().unwrap().content();\n let name = Path::new(entry.name().unwrap_or_default());\n SyncModel::from_bytes(content.into(), name)?.map(|m| m.0)\n }\n Err(_) => None,\n },\n };\n\n let next = {\n let full_path = repo.workdir().unwrap().join(rela_path.clone());\n SyncModel::from_file(full_path.as_path())?.map(|m| m.0)\n };\n\n entries.push(GitStatusEntry {\n status,\n staged,\n rela_path,\n prev: prev.clone(),\n next: next.clone(),\n })\n }\n\n let origins = repo.remotes()?.into_iter().filter_map(|o| Some(o?.to_string())).collect();\n let local_branches = local_branch_names(&repo)?;\n let remote_branches = remote_branch_names(&repo)?;\n\n // Compute ahead/behind relative to remote tracking branch\n let (ahead, behind) = (|| -> Option<(usize, usize)> {\n let head = repo.head().ok()?;\n let local_oid = head.target()?;\n let branch_name = head.shorthand()?;\n let upstream_ref =\n repo.find_branch(&format!(\"origin/{branch_name}\"), git2::BranchType::Remote).ok()?;\n let upstream_oid = upstream_ref.get().target()?;\n repo.graph_ahead_behind(local_oid, upstream_oid).ok()\n })()\n .unwrap_or((0, 0));\n\n Ok(GitStatusSummary {\n entries,\n origins,\n path: dir.to_string_lossy().to_string(),\n head_ref,\n head_ref_shorthand,\n local_branches,\n remote_branches,\n ahead: ahead as u32,\n behind: behind as u32,\n })\n}\n" }, { "path": "crates/yaak-git/src/unstage.rs", "content": "use crate::repository::open_repo;\nuse log::info;\nuse std::path::Path;\n\npub fn git_unstage(dir: &Path, rela_path: &Path) -> crate::error::Result<()> {\n let repo = open_repo(dir)?;\n\n let head = match repo.head() {\n Ok(h) => h,\n Err(e) if e.code() == git2::ErrorCode::UnbornBranch => {\n info!(\"Unstaging file in empty branch {rela_path:?} to {dir:?}\");\n // Repo has no commits, so \"unstage\" means remove from index\n let mut index = repo.index()?;\n index.remove_path(rela_path)?;\n index.write()?;\n return Ok(());\n }\n Err(e) => return Err(e.into()),\n };\n\n // If repo has commits, update the index entry back to HEAD\n info!(\"Unstaging file {rela_path:?} to {dir:?}\");\n let commit = head.peel_to_commit()?;\n repo.reset_default(Some(commit.as_object()), &[rela_path])?;\n\n Ok(())\n}\n" }, { "path": "crates/yaak-git/src/util.rs", "content": "use crate::error::Error::{GenericError, NoDefaultRemoteFound};\nuse crate::error::Result;\nuse git2::{Branch, BranchType, Remote, Repository};\n\nconst DEFAULT_REMOTE_NAME: &str = \"origin\";\n\npub(crate) fn get_current_branch(repo: &Repository) -> Result>> {\n for b in repo.branches(None)? {\n let branch = b?.0;\n if branch.is_head() {\n return Ok(Some(branch));\n }\n }\n Ok(None)\n}\n\npub(crate) fn get_current_branch_name(repo: &Repository) -> Result {\n Ok(get_current_branch(&repo)?\n .ok_or(GenericError(\"Failed to get current branch\".to_string()))?\n .name()?\n .ok_or(GenericError(\"Failed to get current branch name\".to_string()))?\n .to_string())\n}\n\npub(crate) fn local_branch_names(repo: &Repository) -> Result> {\n let mut branches = Vec::new();\n for branch in repo.branches(Some(BranchType::Local))? {\n let (branch, _) = branch?;\n let name = branch.name_bytes()?;\n let name = bytes_to_string(name)?;\n branches.push(name);\n }\n Ok(branches)\n}\n\npub(crate) fn remote_branch_names(repo: &Repository) -> Result> {\n let mut branches = Vec::new();\n for branch in repo.branches(Some(BranchType::Remote))? {\n let (branch, _) = branch?;\n let name = branch.name_bytes()?;\n let name = bytes_to_string(name)?;\n if name.ends_with(\"/HEAD\") {\n continue;\n }\n branches.push(name);\n }\n Ok(branches)\n}\n\npub(crate) fn bytes_to_string(bytes: &[u8]) -> Result {\n Ok(String::from_utf8(bytes.to_vec())?)\n}\n\npub(crate) fn get_default_remote_for_push_in_repo(repo: &'_ Repository) -> Result> {\n let name = get_default_remote_name_for_push_in_repo(repo)?;\n let remote = repo.find_remote(&name)?;\n Ok(remote)\n}\n\npub(crate) fn get_default_remote_name_for_push_in_repo(repo: &Repository) -> Result {\n let config = repo.config()?;\n\n let branch = get_current_branch(repo)?;\n\n if let Some(branch) = branch {\n let remote_name = bytes_to_string(branch.name_bytes()?)?;\n\n let entry_name = format!(\"branch.{}.pushRemote\", &remote_name);\n\n if let Ok(entry) = config.get_entry(&entry_name) {\n return bytes_to_string(entry.value_bytes());\n }\n\n if let Ok(entry) = config.get_entry(\"remote.pushDefault\") {\n return bytes_to_string(entry.value_bytes());\n }\n\n let entry_name = format!(\"branch.{}.remote\", &remote_name);\n\n if let Ok(entry) = config.get_entry(&entry_name) {\n return bytes_to_string(entry.value_bytes());\n }\n }\n\n get_default_remote_name_in_repo(repo)\n}\n\npub(crate) fn get_default_remote_in_repo(repo: &'_ Repository) -> Result> {\n let name = get_default_remote_name_in_repo(repo)?;\n let remote = repo.find_remote(&name)?;\n Ok(remote)\n}\n\npub(crate) fn get_default_remote_name_in_repo(repo: &Repository) -> Result {\n let remotes = repo.remotes()?;\n\n if remotes.is_empty() {\n return Err(NoDefaultRemoteFound);\n }\n\n // if `origin` exists return that\n let found_origin = remotes.iter().any(|r| r.is_some_and(|r| r == DEFAULT_REMOTE_NAME));\n if found_origin {\n return Ok(DEFAULT_REMOTE_NAME.into());\n }\n\n // if only one remote exists, pick that\n if remotes.len() == 1 {\n let first_remote = remotes\n .iter()\n .next()\n .flatten()\n .map(String::from)\n .ok_or_else(|| GenericError(\"no remote found\".into()))?;\n\n return Ok(first_remote);\n }\n\n // inconclusive\n Err(NoDefaultRemoteFound)\n}\n" }, { "path": "crates/yaak-grpc/Cargo.toml", "content": "[package]\nname = \"yaak-grpc\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nanyhow = \"1.0.97\"\nasync-recursion = \"1.1.1\"\ndunce = \"1.0.4\"\nhyper-rustls = { version = \"0.27.7\", default-features = false, features = [\"http2\"] }\nhyper-util = { version = \"0.1.13\", default-features = false, features = [\"client-legacy\"] }\nlog = { workspace = true }\nmd5 = \"0.7.0\"\nprost = \"0.13.4\"\nprost-reflect = { version = \"0.14.4\", default-features = false, features = [\"serde\", \"derive\"] }\nprost-types = \"0.13.4\"\nserde = { workspace = true, features = [\"derive\"] }\nserde_json = { workspace = true }\ntokio = { workspace = true, features = [\"macros\", \"rt-multi-thread\", \"fs\", \"process\"] }\ntokio-stream = \"0.1.14\"\ntonic = { version = \"0.12.3\", default-features = false, features = [\"transport\"] }\ntonic-reflection = \"0.12.3\"\nuuid = { version = \"1.7.0\", features = [\"v4\"] }\nyaak-common = { workspace = true }\nyaak-tls = { workspace = true }\nthiserror = \"2.0.17\"\n" }, { "path": "crates/yaak-grpc/src/any.rs", "content": "use log::error;\n\npub(crate) fn collect_any_types(json: &str, out: &mut Vec) {\n let value = match serde_json::from_str(json).map_err(|e| e.to_string()) {\n Ok(v) => v,\n Err(e) => {\n error!(\"Failed to parse gRPC message JSON: {e:?}\");\n return;\n }\n };\n collect_any_types_value(&value, out);\n}\n\nfn collect_any_types_value(json: &serde_json::Value, out: &mut Vec) {\n match json {\n serde_json::Value::Object(map) => {\n if let Some(t) = map.get(\"@type\").and_then(|v| v.as_str()) {\n if let Some(full_name) = t.rsplit_once('/').map(|(_, n)| n) {\n out.push(full_name.to_string());\n }\n }\n\n for v in map.values() {\n collect_any_types_value(v, out);\n }\n }\n serde_json::Value::Array(arr) => {\n for v in arr {\n collect_any_types_value(v, out);\n }\n }\n _ => {}\n }\n}\n\n// Write tests for this\n#[cfg(test)]\nmod tests {\n #[test]\n fn test_collect_any_types() {\n let json = r#\"{\n \"mounts\": [\n {\n \"mountSource\": {\n \"@type\": \"type.googleapis.com/mount_source.MountSourceRBDVolume\",\n \"volumeID\": \"volumes/rbd\"\n }\n }\n ],\n \"foo\": {\n \"@type\": \"type.googleapis.com/foo.bar\",\n \"foo\": \"fooo\"\n }\n }\"#;\n\n let mut out = Vec::new();\n super::collect_any_types(json, &mut out);\n out.sort();\n assert_eq!(out, vec![\"foo.bar\", \"mount_source.MountSourceRBDVolume\"]);\n }\n}\n" }, { "path": "crates/yaak-grpc/src/client.rs", "content": "use crate::error::Error::GenericError;\nuse crate::error::Result;\nuse crate::manager::decorate_req;\nuse crate::transport::get_transport;\nuse async_recursion::async_recursion;\nuse hyper_rustls::HttpsConnector;\nuse hyper_util::client::legacy::Client;\nuse hyper_util::client::legacy::connect::HttpConnector;\nuse log::debug;\nuse std::collections::BTreeMap;\nuse tokio_stream::StreamExt;\nuse tonic::Request;\nuse tonic::body::BoxBody;\nuse tonic::transport::Uri;\nuse tonic_reflection::pb::v1::server_reflection_request::MessageRequest;\nuse tonic_reflection::pb::v1::server_reflection_response::MessageResponse;\nuse tonic_reflection::pb::v1::{\n ErrorResponse, ExtensionNumberResponse, ListServiceResponse, ServerReflectionRequest,\n ServiceResponse,\n};\nuse tonic_reflection::pb::v1::{ExtensionRequest, FileDescriptorResponse};\nuse tonic_reflection::pb::{v1, v1alpha};\nuse yaak_tls::ClientCertificateConfig;\n\npub struct AutoReflectionClient, BoxBody>> {\n use_v1alpha: bool,\n client_v1: v1::server_reflection_client::ServerReflectionClient,\n client_v1alpha: v1alpha::server_reflection_client::ServerReflectionClient,\n}\n\nimpl AutoReflectionClient {\n pub fn new(\n uri: &Uri,\n validate_certificates: bool,\n client_cert: Option,\n ) -> Result {\n let client_v1 = v1::server_reflection_client::ServerReflectionClient::with_origin(\n get_transport(validate_certificates, client_cert.clone())?,\n uri.clone(),\n );\n let client_v1alpha = v1alpha::server_reflection_client::ServerReflectionClient::with_origin(\n get_transport(validate_certificates, client_cert.clone())?,\n uri.clone(),\n );\n Ok(AutoReflectionClient { use_v1alpha: false, client_v1, client_v1alpha })\n }\n\n #[async_recursion]\n pub async fn send_reflection_request(\n &mut self,\n message: MessageRequest,\n metadata: &BTreeMap,\n ) -> Result {\n let reflection_request = ServerReflectionRequest {\n host: \"\".into(), // Doesn't matter\n message_request: Some(message.clone()),\n };\n\n if self.use_v1alpha {\n let mut request =\n Request::new(tokio_stream::once(to_v1alpha_request(reflection_request)));\n decorate_req(metadata, &mut request)?;\n\n self.client_v1alpha\n .server_reflection_info(request)\n .await\n .map_err(|e| match e.code() {\n tonic::Code::Unavailable => {\n GenericError(\"Failed to connect to endpoint\".to_string())\n }\n tonic::Code::Unauthenticated => {\n GenericError(\"Authentication failed\".to_string())\n }\n tonic::Code::DeadlineExceeded => GenericError(\"Deadline exceeded\".to_string()),\n _ => GenericError(e.to_string()),\n })?\n .into_inner()\n .next()\n .await\n .ok_or(GenericError(\"Missing reflection message\".to_string()))??\n .message_response\n .ok_or(GenericError(\"No reflection response\".to_string()))\n .map(|resp| to_v1_msg_response(resp))\n } else {\n let mut request = Request::new(tokio_stream::once(reflection_request));\n decorate_req(metadata, &mut request)?;\n\n let resp = self.client_v1.server_reflection_info(request).await;\n match resp {\n Ok(r) => Ok(r),\n Err(e) => match e.code().clone() {\n tonic::Code::Unimplemented => {\n // If v1 fails, change to v1alpha and try again\n debug!(\"gRPC schema reflection falling back to v1alpha\");\n self.use_v1alpha = true;\n return self.send_reflection_request(message, metadata).await;\n }\n _ => Err(e),\n },\n }\n .map_err(|e| match e.code() {\n tonic::Code::Unavailable => {\n GenericError(\"Failed to connect to endpoint\".to_string())\n }\n tonic::Code::Unauthenticated => GenericError(\"Authentication failed\".to_string()),\n tonic::Code::DeadlineExceeded => GenericError(\"Deadline exceeded\".to_string()),\n _ => GenericError(e.to_string()),\n })?\n .into_inner()\n .next()\n .await\n .ok_or(GenericError(\"Missing reflection message\".to_string()))??\n .message_response\n .ok_or(GenericError(\"No reflection response\".to_string()))\n }\n }\n}\n\nfn to_v1_msg_response(\n response: v1alpha::server_reflection_response::MessageResponse,\n) -> MessageResponse {\n match response {\n v1alpha::server_reflection_response::MessageResponse::FileDescriptorResponse(v) => {\n MessageResponse::FileDescriptorResponse(FileDescriptorResponse {\n file_descriptor_proto: v.file_descriptor_proto,\n })\n }\n v1alpha::server_reflection_response::MessageResponse::AllExtensionNumbersResponse(v) => {\n MessageResponse::AllExtensionNumbersResponse(ExtensionNumberResponse {\n extension_number: v.extension_number,\n base_type_name: v.base_type_name,\n })\n }\n v1alpha::server_reflection_response::MessageResponse::ListServicesResponse(v) => {\n MessageResponse::ListServicesResponse(ListServiceResponse {\n service: v\n .service\n .iter()\n .map(|s| ServiceResponse { name: s.name.clone() })\n .collect(),\n })\n }\n v1alpha::server_reflection_response::MessageResponse::ErrorResponse(v) => {\n MessageResponse::ErrorResponse(ErrorResponse {\n error_code: v.error_code,\n error_message: v.error_message,\n })\n }\n }\n}\n\nfn to_v1alpha_request(request: ServerReflectionRequest) -> v1alpha::ServerReflectionRequest {\n v1alpha::ServerReflectionRequest {\n host: request.host,\n message_request: request.message_request.map(|m| to_v1alpha_msg_request(m)),\n }\n}\n\nfn to_v1alpha_msg_request(\n message: MessageRequest,\n) -> v1alpha::server_reflection_request::MessageRequest {\n match message {\n MessageRequest::FileByFilename(v) => {\n v1alpha::server_reflection_request::MessageRequest::FileByFilename(v)\n }\n MessageRequest::FileContainingSymbol(v) => {\n v1alpha::server_reflection_request::MessageRequest::FileContainingSymbol(v)\n }\n MessageRequest::FileContainingExtension(ExtensionRequest {\n extension_number,\n containing_type,\n }) => v1alpha::server_reflection_request::MessageRequest::FileContainingExtension(\n v1alpha::ExtensionRequest { extension_number, containing_type },\n ),\n MessageRequest::AllExtensionNumbersOfType(v) => {\n v1alpha::server_reflection_request::MessageRequest::AllExtensionNumbersOfType(v)\n }\n MessageRequest::ListServices(v) => {\n v1alpha::server_reflection_request::MessageRequest::ListServices(v)\n }\n }\n}\n" }, { "path": "crates/yaak-grpc/src/codec.rs", "content": "use prost_reflect::prost::Message;\nuse prost_reflect::{DynamicMessage, MethodDescriptor};\nuse tonic::Status;\nuse tonic::codec::{Codec, DecodeBuf, Decoder, EncodeBuf, Encoder};\n\n#[derive(Clone)]\npub struct DynamicCodec(MethodDescriptor);\n\nimpl DynamicCodec {\n #[allow(dead_code)]\n pub fn new(md: MethodDescriptor) -> Self {\n Self(md)\n }\n}\n\nimpl Codec for DynamicCodec {\n type Encode = DynamicMessage;\n type Decode = DynamicMessage;\n type Encoder = Self;\n type Decoder = Self;\n\n fn encoder(&mut self) -> Self::Encoder {\n self.clone()\n }\n\n fn decoder(&mut self) -> Self::Decoder {\n self.clone()\n }\n}\n\nimpl Encoder for DynamicCodec {\n type Item = DynamicMessage;\n type Error = Status;\n\n fn encode(&mut self, item: Self::Item, dst: &mut EncodeBuf<'_>) -> Result<(), Self::Error> {\n item.encode(dst).expect(\"buffer is too small to decode this message\");\n Ok(())\n }\n}\n\nimpl Decoder for DynamicCodec {\n type Item = DynamicMessage;\n type Error = Status;\n\n fn decode(&mut self, src: &mut DecodeBuf<'_>) -> Result, Self::Error> {\n let mut msg = DynamicMessage::new(self.0.output());\n msg.merge(src).map_err(|err| Status::internal(err.to_string()))?;\n Ok(Some(msg))\n }\n}\n" }, { "path": "crates/yaak-grpc/src/error.rs", "content": "use crate::manager::GrpcStreamError;\nuse prost::DecodeError;\nuse serde::{Serialize, Serializer};\nuse serde_json::Error as SerdeJsonError;\nuse std::io;\nuse thiserror::Error;\nuse tonic::Status;\n\n#[derive(Error, Debug)]\npub enum Error {\n #[error(transparent)]\n TlsError(#[from] yaak_tls::error::Error),\n\n #[error(transparent)]\n TonicError(#[from] Status),\n\n #[error(\"Prost reflect error: {0:?}\")]\n ProstReflectError(#[from] prost_reflect::DescriptorError),\n\n #[error(transparent)]\n DeserializerError(#[from] SerdeJsonError),\n\n #[error(transparent)]\n GrpcStreamError(#[from] GrpcStreamError),\n\n #[error(transparent)]\n GrpcDecodeError(#[from] DecodeError),\n\n #[error(transparent)]\n GrpcInvalidMetadataKeyError(#[from] tonic::metadata::errors::InvalidMetadataKey),\n\n #[error(transparent)]\n GrpcInvalidMetadataValueError(#[from] tonic::metadata::errors::InvalidMetadataValue),\n\n #[error(transparent)]\n IOError(#[from] io::Error),\n\n #[error(\"GRPC error: {0}\")]\n GenericError(String),\n}\n\nimpl Serialize for Error {\n fn serialize(&self, serializer: S) -> std::result::Result\n where\n S: Serializer,\n {\n serializer.serialize_str(self.to_string().as_ref())\n }\n}\n\npub type Result = std::result::Result;\n" }, { "path": "crates/yaak-grpc/src/json_schema.rs", "content": "use prost_reflect::{DescriptorPool, FieldDescriptor, MessageDescriptor};\nuse std::collections::{HashMap, HashSet, VecDeque};\n\npub fn message_to_json_schema(_: &DescriptorPool, root_msg: MessageDescriptor) -> JsonSchemaEntry {\n JsonSchemaGenerator::generate_json_schema(root_msg)\n}\n\nstruct JsonSchemaGenerator {\n msg_mapping: HashMap,\n}\n\nimpl JsonSchemaGenerator {\n pub fn new() -> Self {\n JsonSchemaGenerator { msg_mapping: HashMap::new() }\n }\n\n pub fn generate_json_schema(msg: MessageDescriptor) -> JsonSchemaEntry {\n let generator = JsonSchemaGenerator::new();\n generator.scan_root(msg)\n }\n\n fn add_message(&mut self, msg: &MessageDescriptor) {\n let name = msg.full_name().to_string();\n if self.msg_mapping.contains_key(&name) {\n return;\n }\n self.msg_mapping.insert(name.clone(), JsonSchemaEntry::object());\n }\n\n pub fn scan_root(mut self, root_msg: MessageDescriptor) -> JsonSchemaEntry {\n self.init_structure(root_msg.clone());\n self.fill_properties(root_msg.clone());\n\n let mut root = self.msg_mapping.remove(root_msg.full_name()).unwrap();\n\n if self.msg_mapping.len() > 0 {\n root.defs = Some(self.msg_mapping);\n }\n root\n }\n\n fn fill_properties(&mut self, root_msg: MessageDescriptor) {\n let root_name = root_msg.full_name().to_string();\n\n let mut visited = HashSet::new();\n let mut msg_queue = VecDeque::new();\n msg_queue.push_back(root_msg);\n\n while !msg_queue.is_empty() {\n let msg = msg_queue.pop_front().unwrap();\n let msg_name = msg.full_name();\n if visited.contains(msg_name) {\n continue;\n }\n\n visited.insert(msg_name.to_string());\n\n let entry = self.msg_mapping.get_mut(msg_name).unwrap();\n\n for field in msg.fields() {\n let field_name = field.name().to_string();\n\n if matches!(field.cardinality(), prost_reflect::Cardinality::Required) {\n entry.add_required(field_name.clone());\n }\n\n if let Some(oneof) = field.containing_oneof() {\n for oneof_field in oneof.fields() {\n if let Some(fm) = is_message_field(&oneof_field) {\n msg_queue.push_back(fm);\n }\n entry.add_property(\n oneof_field.name().to_string(),\n field_to_type_or_ref(&root_name, oneof_field),\n );\n }\n continue;\n }\n\n let (field_type, nest_msg) = {\n if let Some(fm) = is_message_field(&field) {\n if field.is_list() {\n // repeated message type\n (\n JsonSchemaEntry::array(field_to_type_or_ref(&root_name, field)),\n Some(fm),\n )\n } else if field.is_map() {\n let value_field = fm.get_field_by_name(\"value\").unwrap();\n\n if let Some(fm) = is_message_field(&value_field) {\n (\n JsonSchemaEntry::map(field_to_type_or_ref(\n &root_name,\n value_field,\n )),\n Some(fm),\n )\n } else {\n (\n JsonSchemaEntry::map(field_to_type_or_ref(\n &root_name,\n value_field,\n )),\n None,\n )\n }\n } else {\n (field_to_type_or_ref(&root_name, field), Some(fm))\n }\n } else {\n if field.is_list() {\n // repeated scalar type\n (JsonSchemaEntry::array(field_to_type_or_ref(&root_name, field)), None)\n } else {\n (field_to_type_or_ref(&root_name, field), None)\n }\n }\n };\n\n if let Some(fm) = nest_msg {\n msg_queue.push_back(fm);\n }\n\n entry.add_property(field_name, field_type);\n }\n }\n }\n\n fn init_structure(&mut self, root_msg: MessageDescriptor) {\n let mut visited = HashSet::new();\n let mut msg_queue = VecDeque::new();\n msg_queue.push_back(root_msg.clone());\n\n // level traversal, to make sure all message type is defined before used\n while !msg_queue.is_empty() {\n let msg = msg_queue.pop_front().unwrap();\n let name = msg.full_name();\n if visited.contains(name) {\n continue;\n }\n visited.insert(name.to_string());\n self.add_message(&msg);\n\n for child in msg.child_messages() {\n if child.is_map_entry() {\n // for field with map type, there will be a child message type *Entry generated\n // just skip it\n continue;\n }\n\n self.add_message(&child);\n msg_queue.push_back(child);\n }\n\n for field in msg.fields() {\n if let Some(oneof) = field.containing_oneof() {\n for oneof_field in oneof.fields() {\n if let Some(fm) = is_message_field(&oneof_field) {\n self.add_message(&fm);\n msg_queue.push_back(fm);\n }\n }\n continue;\n }\n if field.is_map() {\n // key is always scalar type, so no need to process\n // value can be any type, so need to unpack value type\n let map_field_msg = is_message_field(&field).unwrap();\n let map_value_field = map_field_msg.get_field_by_name(\"value\").unwrap();\n if let Some(value_fm) = is_message_field(&map_value_field) {\n self.add_message(&value_fm);\n msg_queue.push_back(value_fm);\n }\n continue;\n }\n if let Some(fm) = is_message_field(&field) {\n self.add_message(&fm);\n msg_queue.push_back(fm);\n }\n }\n }\n }\n}\n\nfn field_to_type_or_ref(root_name: &str, field: FieldDescriptor) -> JsonSchemaEntry {\n match field.kind() {\n prost_reflect::Kind::Bool => JsonSchemaEntry::boolean(),\n prost_reflect::Kind::Double => JsonSchemaEntry::number(\"double\"),\n prost_reflect::Kind::Float => JsonSchemaEntry::number(\"float\"),\n prost_reflect::Kind::Int32 => JsonSchemaEntry::number(\"int32\"),\n prost_reflect::Kind::Int64 => JsonSchemaEntry::string_with_format(\"int64\"),\n prost_reflect::Kind::Uint32 => JsonSchemaEntry::number(\"int64\"),\n prost_reflect::Kind::Uint64 => JsonSchemaEntry::string_with_format(\"uint64\"),\n prost_reflect::Kind::Sint32 => JsonSchemaEntry::number(\"sint32\"),\n prost_reflect::Kind::Sint64 => JsonSchemaEntry::string_with_format(\"sint64\"),\n prost_reflect::Kind::Fixed32 => JsonSchemaEntry::number(\"int64\"),\n prost_reflect::Kind::Fixed64 => JsonSchemaEntry::string_with_format(\"fixed64\"),\n prost_reflect::Kind::Sfixed32 => JsonSchemaEntry::number(\"sfixed32\"),\n prost_reflect::Kind::Sfixed64 => JsonSchemaEntry::string_with_format(\"sfixed64\"),\n prost_reflect::Kind::String => JsonSchemaEntry::string(),\n prost_reflect::Kind::Bytes => JsonSchemaEntry::string_with_format(\"byte\"),\n prost_reflect::Kind::Enum(enums) => {\n let values = enums.values().map(|v| v.name().to_string()).collect::>();\n JsonSchemaEntry::enums(values)\n }\n prost_reflect::Kind::Message(fm) => {\n let field_type_full_name = fm.full_name();\n match field_type_full_name {\n // [Protocol Buffers Well-Known Types]: https://protobuf.dev/reference/protobuf/google.protobuf/\n \"google.protobuf.FieldMask\" => JsonSchemaEntry::string(),\n \"google.protobuf.Timestamp\" => JsonSchemaEntry::string_with_format(\"date-time\"),\n \"google.protobuf.Duration\" => JsonSchemaEntry::string(),\n \"google.protobuf.StringValue\" => JsonSchemaEntry::string(),\n \"google.protobuf.BytesValue\" => JsonSchemaEntry::string_with_format(\"byte\"),\n \"google.protobuf.Int32Value\" => JsonSchemaEntry::number(\"int32\"),\n \"google.protobuf.UInt32Value\" => JsonSchemaEntry::string_with_format(\"int64\"),\n \"google.protobuf.Int64Value\" => JsonSchemaEntry::string_with_format(\"int64\"),\n \"google.protobuf.UInt64Value\" => JsonSchemaEntry::string_with_format(\"uint64\"),\n \"google.protobuf.FloatValue\" => JsonSchemaEntry::number(\"float\"),\n \"google.protobuf.DoubleValue\" => JsonSchemaEntry::number(\"double\"),\n \"google.protobuf.BoolValue\" => JsonSchemaEntry::boolean(),\n \"google.protobuf.Empty\" => JsonSchemaEntry::default(),\n \"google.protobuf.Struct\" => JsonSchemaEntry::object(),\n \"google.protobuf.ListValue\" => JsonSchemaEntry::array(JsonSchemaEntry::default()),\n \"google.protobuf.NullValue\" => JsonSchemaEntry::null(),\n name @ _ if name == root_name => JsonSchemaEntry::root_reference(),\n _ => JsonSchemaEntry::reference(fm.full_name()),\n }\n }\n }\n}\n\nfn is_message_field(field: &FieldDescriptor) -> Option {\n match field.kind() {\n prost_reflect::Kind::Message(m) => Some(m),\n _ => None,\n }\n}\n\n#[derive(Default, serde::Serialize)]\n#[serde(default, rename_all = \"camelCase\")]\npub struct JsonSchemaEntry {\n #[serde(skip_serializing_if = \"Option::is_none\")]\n title: Option,\n\n #[serde(rename = \"type\", skip_serializing_if = \"Option::is_none\")]\n type_: Option,\n\n #[serde(skip_serializing_if = \"Option::is_none\")]\n format: Option,\n\n #[serde(skip_serializing_if = \"Option::is_none\")]\n description: Option,\n\n #[serde(skip_serializing_if = \"Option::is_none\")]\n properties: Option>,\n\n #[serde(rename = \"enum\", skip_serializing_if = \"Option::is_none\")]\n enum_: Option>,\n\n // for map type\n #[serde(skip_serializing_if = \"Option::is_none\")]\n additional_properties: Option>,\n\n // Set all properties to required\n #[serde(skip_serializing_if = \"Option::is_none\")]\n required: Option>,\n\n #[serde(skip_serializing_if = \"Option::is_none\")]\n items: Option>,\n\n #[serde(skip_serializing_if = \"Option::is_none\", rename = \"$defs\")]\n defs: Option>,\n\n #[serde(skip_serializing_if = \"Option::is_none\", rename = \"$ref\")]\n ref_: Option,\n}\n\nimpl JsonSchemaEntry {\n pub fn add_property(&mut self, name: String, entry: JsonSchemaEntry) {\n if self.properties.is_none() {\n self.properties = Some(HashMap::new());\n }\n self.properties.as_mut().unwrap().insert(name, entry);\n }\n\n pub fn add_required(&mut self, name: String) {\n if self.required.is_none() {\n self.required = Some(Vec::new());\n }\n self.required.as_mut().unwrap().push(name);\n }\n}\n\nimpl JsonSchemaEntry {\n pub fn object() -> Self {\n JsonSchemaEntry { type_: Some(JsonType::Object), ..Default::default() }\n }\n pub fn boolean() -> Self {\n JsonSchemaEntry { type_: Some(JsonType::Boolean), ..Default::default() }\n }\n pub fn number>(format: S) -> Self {\n JsonSchemaEntry {\n type_: Some(JsonType::Number),\n format: Some(format.into()),\n ..Default::default()\n }\n }\n pub fn string() -> Self {\n JsonSchemaEntry { type_: Some(JsonType::String), ..Default::default() }\n }\n\n pub fn string_with_format>(format: S) -> Self {\n JsonSchemaEntry {\n type_: Some(JsonType::String),\n format: Some(format.into()),\n ..Default::default()\n }\n }\n pub fn reference>(ref_: S) -> Self {\n JsonSchemaEntry { ref_: Some(format!(\"#/$defs/{}\", ref_.as_ref())), ..Default::default() }\n }\n pub fn root_reference() -> Self {\n JsonSchemaEntry { ref_: Some(\"#\".to_string()), ..Default::default() }\n }\n pub fn array(item: JsonSchemaEntry) -> Self {\n JsonSchemaEntry {\n type_: Some(JsonType::Array),\n items: Some(Box::new(item)),\n ..Default::default()\n }\n }\n pub fn enums(enums: Vec) -> Self {\n JsonSchemaEntry { type_: Some(JsonType::String), enum_: Some(enums), ..Default::default() }\n }\n\n pub fn map(value_type: JsonSchemaEntry) -> Self {\n JsonSchemaEntry {\n type_: Some(JsonType::Object),\n additional_properties: Some(Box::new(value_type)),\n ..Default::default()\n }\n }\n\n pub fn null() -> Self {\n JsonSchemaEntry { type_: Some(JsonType::Null), ..Default::default() }\n }\n}\n\nenum JsonType {\n String,\n Number,\n Object,\n Array,\n Boolean,\n Null,\n _UNKNOWN,\n}\n\nimpl Default for JsonType {\n fn default() -> Self {\n JsonType::_UNKNOWN\n }\n}\n\nimpl serde::Serialize for JsonType {\n fn serialize(&self, serializer: S) -> std::result::Result\n where\n S: serde::Serializer,\n {\n match self {\n JsonType::String => serializer.serialize_str(\"string\"),\n JsonType::Number => serializer.serialize_str(\"number\"),\n JsonType::Object => serializer.serialize_str(\"object\"),\n JsonType::Array => serializer.serialize_str(\"array\"),\n JsonType::Boolean => serializer.serialize_str(\"boolean\"),\n JsonType::Null => serializer.serialize_str(\"null\"),\n JsonType::_UNKNOWN => serializer.serialize_str(\"unknown\"),\n }\n }\n}\n" }, { "path": "crates/yaak-grpc/src/lib.rs", "content": "use prost_reflect::{DynamicMessage, MethodDescriptor, SerializeOptions};\nuse serde::{Deserialize, Serialize};\nuse serde_json::Deserializer;\n\nmod any;\nmod client;\nmod codec;\npub mod error;\nmod json_schema;\npub mod manager;\nmod reflection;\nmod transport;\n\npub use tonic::Code;\npub use tonic::metadata::*;\n\npub fn serialize_options() -> SerializeOptions {\n SerializeOptions::new().skip_default_fields(false)\n}\n\n#[derive(Serialize, Deserialize, Debug, Default)]\n#[serde(default, rename_all = \"camelCase\")]\npub struct ServiceDefinition {\n pub name: String,\n pub methods: Vec,\n}\n\n#[derive(Serialize, Deserialize, Debug, Default)]\n#[serde(default, rename_all = \"camelCase\")]\npub struct MethodDefinition {\n pub name: String,\n pub schema: String,\n pub client_streaming: bool,\n pub server_streaming: bool,\n}\n\nstatic SERIALIZE_OPTIONS: &'static SerializeOptions =\n &SerializeOptions::new().skip_default_fields(false).stringify_64_bit_integers(false);\n\npub fn serialize_message(msg: &DynamicMessage) -> Result {\n let mut buf = Vec::new();\n let mut se = serde_json::Serializer::pretty(&mut buf);\n msg.serialize_with_options(&mut se, SERIALIZE_OPTIONS).map_err(|e| e.to_string())?;\n let s = String::from_utf8(buf).expect(\"serde_json to emit valid utf8\");\n Ok(s)\n}\n\npub fn deserialize_message(msg: &str, method: MethodDescriptor) -> Result {\n let mut deserializer = Deserializer::from_str(&msg);\n let req_message = DynamicMessage::deserialize(method.input(), &mut deserializer)\n .map_err(|e| e.to_string())?;\n deserializer.end().map_err(|e| e.to_string())?;\n Ok(req_message)\n}\n" }, { "path": "crates/yaak-grpc/src/manager.rs", "content": "use crate::codec::DynamicCodec;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse crate::reflection::{\n fill_pool_from_files, fill_pool_from_reflection, method_desc_to_path, reflect_types_for_message,\n};\nuse crate::transport::get_transport;\nuse crate::{MethodDefinition, ServiceDefinition, json_schema};\nuse hyper_rustls::HttpsConnector;\nuse hyper_util::client::legacy::Client;\nuse hyper_util::client::legacy::connect::HttpConnector;\nuse log::{info, warn};\npub use prost_reflect::DynamicMessage;\nuse prost_reflect::{DescriptorPool, MethodDescriptor, ServiceDescriptor};\nuse serde_json::Deserializer;\nuse std::collections::BTreeMap;\nuse std::error::Error;\nuse std::fmt;\nuse std::fmt::Display;\nuse std::path::PathBuf;\nuse std::str::FromStr;\nuse std::sync::Arc;\nuse tokio::sync::RwLock;\nuse tokio_stream::StreamExt;\nuse tokio_stream::wrappers::ReceiverStream;\nuse tonic::body::BoxBody;\nuse tonic::metadata::{MetadataKey, MetadataValue};\nuse tonic::transport::Uri;\nuse tonic::{IntoRequest, IntoStreamingRequest, Request, Response, Status, Streaming};\nuse yaak_tls::ClientCertificateConfig;\n\n#[derive(Clone)]\npub struct GrpcConnection {\n pool: Arc>,\n conn: Client, BoxBody>,\n pub uri: Uri,\n use_reflection: bool,\n}\n\n#[derive(Default, Debug)]\npub struct GrpcStreamError {\n pub message: String,\n pub status: Option,\n}\n\nimpl Error for GrpcStreamError {}\n\nimpl Display for GrpcStreamError {\n fn fmt(&self, f: &mut fmt::Formatter<'_>) -> fmt::Result {\n match &self.status {\n Some(status) => write!(f, \"[{}] {}\", status, self.message),\n None => write!(f, \"{}\", self.message),\n }\n }\n}\n\nimpl From for GrpcStreamError {\n fn from(value: String) -> Self {\n GrpcStreamError { message: value.to_string(), status: None }\n }\n}\n\nimpl From for GrpcStreamError {\n fn from(s: Status) -> Self {\n GrpcStreamError { message: s.message().to_string(), status: Some(s) }\n }\n}\n\nimpl GrpcConnection {\n pub async fn method(&self, service: &str, method: &str) -> Result {\n let service = self.service(service).await?;\n let method = service\n .methods()\n .find(|m| m.name() == method)\n .ok_or(GenericError(\"Failed to find method\".to_string()))?;\n Ok(method)\n }\n\n async fn service(&self, service: &str) -> Result {\n let pool = self.pool.read().await;\n let service = pool\n .get_service_by_name(service)\n .ok_or(GenericError(\"Failed to find service\".to_string()))?;\n Ok(service)\n }\n\n pub async fn unary(\n &self,\n service: &str,\n method: &str,\n message: &str,\n metadata: &BTreeMap,\n client_cert: Option,\n ) -> Result> {\n if self.use_reflection {\n reflect_types_for_message(self.pool.clone(), &self.uri, message, metadata, client_cert)\n .await?;\n }\n let method = &self.method(&service, &method).await?;\n let input_message = method.input();\n\n let mut deserializer = Deserializer::from_str(message);\n let req_message = DynamicMessage::deserialize(input_message, &mut deserializer)?;\n deserializer.end()?;\n\n let mut client = tonic::client::Grpc::with_origin(self.conn.clone(), self.uri.clone());\n\n let mut req = req_message.into_request();\n decorate_req(metadata, &mut req)?;\n\n let path = method_desc_to_path(method);\n let codec = DynamicCodec::new(method.clone());\n client.ready().await.map_err(|e| GenericError(format!(\"Failed to connect: {}\", e)))?;\n\n Ok(client.unary(req, path, codec).await?)\n }\n\n pub async fn streaming(\n &self,\n service: &str,\n method: &str,\n stream: ReceiverStream,\n metadata: &BTreeMap,\n client_cert: Option,\n on_message: F,\n ) -> Result>>\n where\n F: Fn(std::result::Result) + Send + Sync + Clone + 'static,\n {\n let method = &self.method(&service, &method).await?;\n let mapped_stream = {\n let input_message = method.input();\n let pool = self.pool.clone();\n let uri = self.uri.clone();\n let md = metadata.clone();\n let use_reflection = self.use_reflection.clone();\n let client_cert = client_cert.clone();\n stream\n .then(move |json| {\n let pool = pool.clone();\n let uri = uri.clone();\n let input_message = input_message.clone();\n let md = md.clone();\n let use_reflection = use_reflection.clone();\n let client_cert = client_cert.clone();\n let on_message = on_message.clone();\n let json_clone = json.clone();\n async move {\n if use_reflection {\n if let Err(e) =\n reflect_types_for_message(pool, &uri, &json, &md, client_cert).await\n {\n warn!(\"Failed to resolve Any types: {e}\");\n }\n }\n let mut de = Deserializer::from_str(&json);\n match DynamicMessage::deserialize(input_message, &mut de) {\n Ok(m) => {\n on_message(Ok(json_clone));\n Some(m)\n }\n Err(e) => {\n warn!(\"Failed to deserialize message: {e}\");\n on_message(Err(e.to_string()));\n None\n }\n }\n }\n })\n .filter_map(|x| x)\n };\n\n let mut client = tonic::client::Grpc::with_origin(self.conn.clone(), self.uri.clone());\n let path = method_desc_to_path(method);\n let codec = DynamicCodec::new(method.clone());\n\n let mut req = mapped_stream.into_streaming_request();\n decorate_req(metadata, &mut req)?;\n\n client.ready().await.map_err(|e| GenericError(format!(\"Failed to connect: {}\", e)))?;\n Ok(client.streaming(req, path, codec).await?)\n }\n\n pub async fn client_streaming(\n &self,\n service: &str,\n method: &str,\n stream: ReceiverStream,\n metadata: &BTreeMap,\n client_cert: Option,\n on_message: F,\n ) -> Result>\n where\n F: Fn(std::result::Result) + Send + Sync + Clone + 'static,\n {\n let method = &self.method(&service, &method).await?;\n let mapped_stream = {\n let input_message = method.input();\n let pool = self.pool.clone();\n let uri = self.uri.clone();\n let md = metadata.clone();\n let use_reflection = self.use_reflection.clone();\n let client_cert = client_cert.clone();\n stream\n .then(move |json| {\n let pool = pool.clone();\n let uri = uri.clone();\n let input_message = input_message.clone();\n let md = md.clone();\n let use_reflection = use_reflection.clone();\n let client_cert = client_cert.clone();\n let on_message = on_message.clone();\n let json_clone = json.clone();\n async move {\n if use_reflection {\n if let Err(e) =\n reflect_types_for_message(pool, &uri, &json, &md, client_cert).await\n {\n warn!(\"Failed to resolve Any types: {e}\");\n }\n }\n let mut de = Deserializer::from_str(&json);\n match DynamicMessage::deserialize(input_message, &mut de) {\n Ok(m) => {\n on_message(Ok(json_clone));\n Some(m)\n }\n Err(e) => {\n warn!(\"Failed to deserialize message: {e}\");\n on_message(Err(e.to_string()));\n None\n }\n }\n }\n })\n .filter_map(|x| x)\n };\n\n let mut client = tonic::client::Grpc::with_origin(self.conn.clone(), self.uri.clone());\n let path = method_desc_to_path(method);\n let codec = DynamicCodec::new(method.clone());\n\n let mut req = mapped_stream.into_streaming_request();\n decorate_req(metadata, &mut req)?;\n\n client.ready().await.map_err(|e| GenericError(format!(\"Failed to connect: {}\", e)))?;\n Ok(client\n .client_streaming(req, path, codec)\n .await\n .map_err(|e| GrpcStreamError { message: e.message().to_string(), status: Some(e) })?)\n }\n\n pub async fn server_streaming(\n &self,\n service: &str,\n method: &str,\n message: &str,\n metadata: &BTreeMap,\n ) -> Result>> {\n let method = &self.method(&service, &method).await?;\n let input_message = method.input();\n\n let mut deserializer = Deserializer::from_str(message);\n let req_message = DynamicMessage::deserialize(input_message, &mut deserializer)?;\n deserializer.end()?;\n\n let mut client = tonic::client::Grpc::with_origin(self.conn.clone(), self.uri.clone());\n\n let mut req = req_message.into_request();\n decorate_req(metadata, &mut req)?;\n\n let path = method_desc_to_path(method);\n let codec = DynamicCodec::new(method.clone());\n client.ready().await.map_err(|e| GenericError(format!(\"Failed to connect: {}\", e)))?;\n Ok(client.server_streaming(req, path, codec).await?)\n }\n}\n\n/// Configuration for GrpcHandle to compile proto files\n#[derive(Clone)]\npub struct GrpcConfig {\n /// Path to the protoc include directory (vendored/protoc/include)\n pub protoc_include_dir: PathBuf,\n /// Path to the yaakprotoc sidecar binary\n pub protoc_bin_path: PathBuf,\n}\n\npub struct GrpcHandle {\n config: GrpcConfig,\n pools: BTreeMap,\n}\n\nimpl GrpcHandle {\n pub fn new(config: GrpcConfig) -> Self {\n let pools = BTreeMap::new();\n Self { pools, config }\n }\n}\n\nimpl GrpcHandle {\n /// Remove cached descriptor pool for the given key, if present.\n pub fn invalidate_pool(&mut self, id: &str, uri: &str, proto_files: &Vec) {\n let key = make_pool_key(id, uri, proto_files);\n self.pools.remove(&key);\n }\n\n pub async fn reflect(\n &mut self,\n id: &str,\n uri: &str,\n proto_files: &Vec,\n metadata: &BTreeMap,\n validate_certificates: bool,\n client_cert: Option,\n ) -> Result {\n let server_reflection = proto_files.is_empty();\n let key = make_pool_key(id, uri, proto_files);\n\n // If we already have a pool for this key, reuse it and avoid re-reflection\n if self.pools.contains_key(&key) {\n return Ok(server_reflection);\n }\n\n let pool = if server_reflection {\n let full_uri = uri_from_str(uri)?;\n fill_pool_from_reflection(&full_uri, metadata, validate_certificates, client_cert).await\n } else {\n fill_pool_from_files(&self.config, proto_files).await\n }?;\n\n self.pools.insert(key, pool.clone());\n Ok(server_reflection)\n }\n\n pub async fn services(\n &mut self,\n id: &str,\n uri: &str,\n proto_files: &Vec,\n metadata: &BTreeMap,\n validate_certificates: bool,\n client_cert: Option,\n ) -> Result> {\n // Ensure we have a pool; reflect only if missing\n if self.get_pool(id, uri, proto_files).is_none() {\n info!(\"Reflecting gRPC services for {} at {}\", id, uri);\n self.reflect(id, uri, proto_files, metadata, validate_certificates, client_cert)\n .await?;\n }\n\n let pool = self\n .get_pool(id, uri, proto_files)\n .ok_or(GenericError(\"Failed to get pool\".to_string()))?;\n Ok(self.services_from_pool(&pool))\n }\n\n fn services_from_pool(&self, pool: &DescriptorPool) -> Vec {\n pool.services()\n .map(|s| {\n let mut def =\n ServiceDefinition { name: s.full_name().to_string(), methods: vec![] };\n for method in s.methods() {\n let input_message = method.input();\n def.methods.push(MethodDefinition {\n name: method.name().to_string(),\n server_streaming: method.is_server_streaming(),\n client_streaming: method.is_client_streaming(),\n schema: serde_json::to_string_pretty(&json_schema::message_to_json_schema(\n &pool,\n input_message,\n ))\n .expect(\"Failed to serialize JSON schema\"),\n })\n }\n def\n })\n .collect::>()\n }\n\n pub async fn connect(\n &mut self,\n id: &str,\n uri: &str,\n proto_files: &Vec,\n metadata: &BTreeMap,\n validate_certificates: bool,\n client_cert: Option,\n ) -> Result {\n let use_reflection = proto_files.is_empty();\n if self.get_pool(id, uri, proto_files).is_none() {\n self.reflect(\n id,\n uri,\n proto_files,\n metadata,\n validate_certificates,\n client_cert.clone(),\n )\n .await?;\n }\n let pool = self\n .get_pool(id, uri, proto_files)\n .ok_or(GenericError(\"Failed to get pool\".to_string()))?\n .clone();\n let uri = uri_from_str(uri)?;\n let conn = get_transport(validate_certificates, client_cert.clone())?;\n Ok(GrpcConnection { pool: Arc::new(RwLock::new(pool)), use_reflection, conn, uri })\n }\n\n fn get_pool(&self, id: &str, uri: &str, proto_files: &Vec) -> Option<&DescriptorPool> {\n self.pools.get(make_pool_key(id, uri, proto_files).as_str())\n }\n}\n\npub(crate) fn decorate_req(\n metadata: &BTreeMap,\n req: &mut Request,\n) -> Result<()> {\n for (k, v) in metadata {\n req.metadata_mut()\n .insert(MetadataKey::from_str(k.as_str())?, MetadataValue::from_str(v.as_str())?);\n }\n Ok(())\n}\n\nfn uri_from_str(uri_str: &str) -> Result {\n match Uri::from_str(uri_str) {\n Ok(uri) => Ok(uri),\n Err(err) => {\n // Uri::from_str basically only returns \"invalid format\" so we add more context here\n Err(GenericError(format!(\"Failed to parse URL, {}\", err.to_string())))\n }\n }\n}\n\nfn make_pool_key(id: &str, uri: &str, proto_files: &Vec) -> String {\n let pool_key = format!(\n \"{}::{}::{}\",\n id,\n uri,\n proto_files\n .iter()\n .map(|p| p.to_string_lossy().to_string())\n .collect::>()\n .join(\":\")\n );\n\n format!(\"{:x}\", md5::compute(pool_key))\n}\n" }, { "path": "crates/yaak-grpc/src/reflection.rs", "content": "use crate::any::collect_any_types;\nuse crate::client::AutoReflectionClient;\nuse crate::error::Error::GenericError;\nuse crate::error::Result;\nuse crate::manager::GrpcConfig;\nuse anyhow::anyhow;\nuse async_recursion::async_recursion;\nuse log::{debug, info, warn};\nuse prost::Message;\nuse prost_reflect::{DescriptorPool, MethodDescriptor};\nuse prost_types::{FileDescriptorProto, FileDescriptorSet};\nuse std::collections::{BTreeMap, HashSet};\nuse std::env::temp_dir;\nuse std::ops::Deref;\nuse std::path::{Path, PathBuf};\nuse std::str::FromStr;\nuse std::sync::Arc;\nuse tokio::fs;\nuse tokio::sync::RwLock;\nuse tonic::codegen::http::uri::PathAndQuery;\nuse tonic::transport::Uri;\nuse tonic_reflection::pb::v1::server_reflection_request::MessageRequest;\nuse tonic_reflection::pb::v1::server_reflection_response::MessageResponse;\nuse yaak_common::command::new_xplatform_command;\nuse yaak_tls::ClientCertificateConfig;\n\npub async fn fill_pool_from_files(\n config: &GrpcConfig,\n paths: &Vec,\n) -> Result {\n let mut pool = DescriptorPool::new();\n let random_file_name = format!(\"{}.desc\", uuid::Uuid::new_v4());\n let desc_path = temp_dir().join(random_file_name);\n\n // HACK: Remove UNC prefix for Windows paths\n let global_import_dir =\n dunce::simplified(config.protoc_include_dir.as_path()).to_string_lossy().to_string();\n let desc_path = dunce::simplified(desc_path.as_path());\n\n let mut args = vec![\n \"--include_imports\".to_string(),\n \"--include_source_info\".to_string(),\n \"-I\".to_string(),\n global_import_dir,\n \"-o\".to_string(),\n desc_path.to_string_lossy().to_string(),\n ];\n\n let mut include_dirs = HashSet::new();\n let mut include_protos = HashSet::new();\n\n for p in paths {\n if !p.exists() {\n continue;\n }\n\n // Dirs are added as includes\n if p.is_dir() {\n include_dirs.insert(p.to_string_lossy().to_string());\n continue;\n }\n\n let parent = p.as_path().parent();\n if let Some(parent_path) = parent {\n match find_parent_proto_dir(parent_path) {\n None => {\n // Add parent/grandparent as fallback\n include_dirs.insert(parent_path.to_string_lossy().to_string());\n if let Some(grandparent_path) = parent_path.parent() {\n include_dirs.insert(grandparent_path.to_string_lossy().to_string());\n }\n }\n Some(p) => {\n include_dirs.insert(p.to_string_lossy().to_string());\n }\n };\n } else {\n debug!(\"ignoring {:?} since it does not exist.\", parent)\n }\n\n include_protos.insert(p.to_string_lossy().to_string());\n }\n\n for d in include_dirs.clone() {\n args.push(\"-I\".to_string());\n args.push(d);\n }\n for p in include_protos.clone() {\n args.push(p);\n }\n\n info!(\"Invoking protoc with {}\", args.join(\" \"));\n\n let mut cmd = new_xplatform_command(&config.protoc_bin_path);\n cmd.args(&args);\n\n let out =\n cmd.output().await.map_err(|e| GenericError(format!(\"Failed to run protoc: {}\", e)))?;\n\n if !out.status.success() {\n return Err(GenericError(format!(\n \"protoc failed with status {}: {}\",\n out.status.code().unwrap_or(-1),\n String::from_utf8_lossy(out.stderr.as_slice())\n )));\n }\n\n let bytes = fs::read(desc_path).await?;\n let fdp = FileDescriptorSet::decode(bytes.deref())?;\n pool.add_file_descriptor_set(fdp)?;\n\n fs::remove_file(desc_path).await?;\n\n Ok(pool)\n}\n\npub async fn fill_pool_from_reflection(\n uri: &Uri,\n metadata: &BTreeMap,\n validate_certificates: bool,\n client_cert: Option,\n) -> Result {\n let mut pool = DescriptorPool::new();\n let mut client = AutoReflectionClient::new(uri, validate_certificates, client_cert)?;\n\n for service in list_services(&mut client, metadata).await? {\n if service == \"grpc.reflection.v1alpha.ServerReflection\" {\n continue;\n }\n if service == \"grpc.reflection.v1.ServerReflection\" {\n continue;\n }\n debug!(\"Fetching descriptors for {}\", service);\n file_descriptor_set_from_service_name(&service, &mut pool, &mut client, metadata).await;\n }\n\n Ok(pool)\n}\n\nasync fn list_services(\n client: &mut AutoReflectionClient,\n metadata: &BTreeMap,\n) -> Result> {\n let response =\n client.send_reflection_request(MessageRequest::ListServices(\"\".into()), metadata).await?;\n\n let list_services_response = match response {\n MessageResponse::ListServicesResponse(resp) => resp,\n _ => panic!(\"Expected a ListServicesResponse variant\"),\n };\n\n Ok(list_services_response.service.iter().map(|s| s.name.clone()).collect::>())\n}\n\nasync fn file_descriptor_set_from_service_name(\n service_name: &str,\n pool: &mut DescriptorPool,\n client: &mut AutoReflectionClient,\n metadata: &BTreeMap,\n) {\n let response = match client\n .send_reflection_request(\n MessageRequest::FileContainingSymbol(service_name.into()),\n metadata,\n )\n .await\n {\n Ok(resp) => resp,\n Err(e) => {\n warn!(\"Error fetching file descriptor for service {}: {:?}\", service_name, e);\n return;\n }\n };\n\n let file_descriptor_response = match response {\n MessageResponse::FileDescriptorResponse(resp) => resp,\n _ => panic!(\"Expected a FileDescriptorResponse variant\"),\n };\n\n add_file_descriptors_to_pool(\n file_descriptor_response.file_descriptor_proto,\n pool,\n client,\n metadata,\n )\n .await;\n}\n\npub(crate) async fn reflect_types_for_message(\n pool: Arc>,\n uri: &Uri,\n json: &str,\n metadata: &BTreeMap,\n client_cert: Option,\n) -> Result<()> {\n // 1. Collect all Any types in the JSON\n let mut extra_types = Vec::new();\n collect_any_types(json, &mut extra_types);\n\n if extra_types.is_empty() {\n return Ok(()); // nothing to do\n }\n\n let mut client = AutoReflectionClient::new(uri, false, client_cert)?;\n for extra_type in extra_types {\n {\n let guard = pool.read().await;\n if guard.get_message_by_name(&extra_type).is_some() {\n continue;\n }\n }\n info!(\"Adding file descriptor for {:?} from reflection\", extra_type);\n let req = MessageRequest::FileContainingSymbol(extra_type.clone().into());\n let resp = match client.send_reflection_request(req, metadata).await {\n Ok(r) => r,\n Err(e) => {\n return Err(GenericError(format!(\n \"Error sending reflection request for @type \\\"{extra_type}\\\": {e:?}\",\n )));\n }\n };\n let files = match resp {\n MessageResponse::FileDescriptorResponse(resp) => resp.file_descriptor_proto,\n _ => panic!(\"Expected a FileDescriptorResponse variant\"),\n };\n\n {\n let mut guard = pool.write().await;\n add_file_descriptors_to_pool(files, &mut *guard, &mut client, metadata).await;\n }\n }\n\n Ok(())\n}\n\n#[async_recursion]\npub(crate) async fn add_file_descriptors_to_pool(\n fds: Vec>,\n pool: &mut DescriptorPool,\n client: &mut AutoReflectionClient,\n metadata: &BTreeMap,\n) {\n let mut topo_sort = topology::SimpleTopoSort::new();\n let mut fd_mapping = std::collections::HashMap::with_capacity(fds.len());\n\n for fd in fds {\n let fdp = FileDescriptorProto::decode(fd.deref()).unwrap();\n\n topo_sort.insert(fdp.name().to_string(), fdp.dependency.clone());\n fd_mapping.insert(fdp.name().to_string(), fdp);\n }\n\n for node in topo_sort {\n match node {\n Ok(node) => {\n if let Some(fdp) = fd_mapping.remove(&node) {\n pool.add_file_descriptor_proto(fdp).expect(\"add file descriptor proto\");\n } else {\n file_descriptor_set_by_filename(node.as_str(), pool, client, metadata).await;\n }\n }\n Err(_) => panic!(\"proto file got cycle!\"),\n }\n }\n}\n\nasync fn file_descriptor_set_by_filename(\n filename: &str,\n pool: &mut DescriptorPool,\n client: &mut AutoReflectionClient,\n metadata: &BTreeMap,\n) {\n // We already fetched this file\n if let Some(_) = pool.get_file_by_name(filename) {\n return;\n }\n\n let msg = MessageRequest::FileByFilename(filename.into());\n let response = client.send_reflection_request(msg, metadata).await;\n let file_descriptor_response = match response {\n Ok(MessageResponse::FileDescriptorResponse(resp)) => resp,\n Ok(_) => {\n panic!(\"Expected a FileDescriptorResponse variant\")\n }\n Err(e) => {\n warn!(\"Error fetching file descriptor for {}: {:?}\", filename, e);\n return;\n }\n };\n\n add_file_descriptors_to_pool(\n file_descriptor_response.file_descriptor_proto,\n pool,\n client,\n metadata,\n )\n .await;\n}\n\npub fn method_desc_to_path(md: &MethodDescriptor) -> PathAndQuery {\n let full_name = md.full_name();\n let (namespace, method_name) = full_name\n .rsplit_once('.')\n .ok_or_else(|| anyhow!(\"invalid method path\"))\n .expect(\"invalid method path\");\n PathAndQuery::from_str(&format!(\"/{}/{}\", namespace, method_name)).expect(\"invalid method path\")\n}\n\nmod topology {\n use std::collections::{HashMap, HashSet};\n\n pub struct SimpleTopoSort {\n out_graph: HashMap>,\n in_graph: HashMap>,\n }\n\n impl SimpleTopoSort\n where\n T: Eq + std::hash::Hash + Clone,\n {\n pub fn new() -> Self {\n SimpleTopoSort { out_graph: HashMap::new(), in_graph: HashMap::new() }\n }\n\n pub fn insert>(&mut self, node: T, deps: I) {\n self.out_graph.entry(node.clone()).or_insert(HashSet::new());\n for dep in deps {\n self.out_graph.entry(node.clone()).or_insert(HashSet::new()).insert(dep.clone());\n self.in_graph.entry(dep.clone()).or_insert(HashSet::new()).insert(node.clone());\n }\n }\n }\n\n impl IntoIterator for SimpleTopoSort\n where\n T: Eq + std::hash::Hash + Clone,\n {\n type Item = as Iterator>::Item;\n type IntoIter = SimpleTopoSortIter;\n\n fn into_iter(self) -> Self::IntoIter {\n SimpleTopoSortIter::new(self)\n }\n }\n\n pub struct SimpleTopoSortIter {\n data: SimpleTopoSort,\n zero_indegree: Vec,\n }\n\n impl SimpleTopoSortIter\n where\n T: Eq + std::hash::Hash + Clone,\n {\n pub fn new(data: SimpleTopoSort) -> Self {\n let mut zero_indegree = Vec::new();\n for (node, _) in data.in_graph.iter() {\n if !data.out_graph.contains_key(node) {\n zero_indegree.push(node.clone());\n }\n }\n for (node, deps) in data.out_graph.iter() {\n if deps.is_empty() {\n zero_indegree.push(node.clone());\n }\n }\n\n SimpleTopoSortIter { data, zero_indegree }\n }\n }\n\n impl Iterator for SimpleTopoSortIter\n where\n T: Eq + std::hash::Hash + Clone,\n {\n type Item = Result;\n\n fn next(&mut self) -> Option {\n if self.zero_indegree.is_empty() {\n if self.data.out_graph.is_empty() {\n return None;\n }\n return Some(Err(\"Cycle detected\"));\n }\n\n let node = self.zero_indegree.pop().unwrap();\n if let Some(parents) = self.data.in_graph.get(&node) {\n for parent in parents.iter() {\n let deps = self.data.out_graph.get_mut(parent).unwrap();\n deps.remove(&node);\n if deps.is_empty() {\n self.zero_indegree.push(parent.clone());\n }\n }\n }\n self.data.out_graph.remove(&node);\n\n Some(Ok(node))\n }\n }\n\n #[test]\n fn test_sort() {\n {\n let mut topo_sort = SimpleTopoSort::new();\n topo_sort.insert(\"a\", []);\n\n for node in topo_sort {\n match node {\n Ok(n) => assert_eq!(n, \"a\"),\n Err(e) => panic!(\"err {}\", e),\n }\n }\n }\n\n {\n let mut topo_sort = SimpleTopoSort::new();\n topo_sort.insert(\"a\", [\"b\"]);\n topo_sort.insert(\"b\", []);\n\n let mut iter = topo_sort.into_iter();\n match iter.next() {\n Some(Ok(n)) => assert_eq!(n, \"b\"),\n _ => panic!(\"err\"),\n }\n match iter.next() {\n Some(Ok(n)) => assert_eq!(n, \"a\"),\n _ => panic!(\"err\"),\n }\n assert_eq!(iter.next(), None);\n }\n }\n}\n\nfn find_parent_proto_dir(start_path: impl AsRef) -> Option {\n let mut dir = start_path.as_ref().canonicalize().ok()?;\n\n loop {\n if let Some(name) = dir.file_name().and_then(|n| n.to_str()) {\n if name == \"proto\" {\n return Some(dir);\n }\n }\n\n let parent = dir.parent()?;\n if parent == dir {\n return None; // Reached root\n }\n\n dir = parent.to_path_buf();\n }\n}\n" }, { "path": "crates/yaak-grpc/src/transport.rs", "content": "use crate::error::Result;\nuse hyper_rustls::{HttpsConnector, HttpsConnectorBuilder};\nuse hyper_util::client::legacy::Client;\nuse hyper_util::client::legacy::connect::HttpConnector;\nuse hyper_util::rt::TokioExecutor;\nuse log::info;\nuse tonic::body::BoxBody;\nuse yaak_tls::{ClientCertificateConfig, get_tls_config};\n\n// I think ALPN breaks this because we're specifying http2_only\nconst WITH_ALPN: bool = false;\n\npub(crate) fn get_transport(\n validate_certificates: bool,\n client_cert: Option,\n) -> Result, BoxBody>> {\n let tls_config = get_tls_config(validate_certificates, WITH_ALPN, client_cert.clone())?;\n\n let mut http = HttpConnector::new();\n http.enforce_http(false);\n\n let connector = HttpsConnectorBuilder::new()\n .with_tls_config(tls_config)\n .https_or_http()\n .enable_http2()\n .build();\n\n let client = Client::builder(TokioExecutor::new())\n .pool_max_idle_per_host(0)\n .http2_only(true)\n .build(connector);\n\n info!(\n \"Created gRPC client validate_certs={} client_cert={}\",\n validate_certificates,\n client_cert.is_some()\n );\n\n Ok(client)\n}\n" }, { "path": "crates/yaak-http/Cargo.toml", "content": "[package]\nname = \"yaak-http\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nasync-compression = { version = \"0.4\", features = [\"tokio\", \"gzip\", \"deflate\", \"brotli\", \"zstd\"] }\nasync-trait = \"0.1\"\nbrotli = \"7\"\nbytes = \"1.11.1\"\ncookie = \"0.18.1\"\nflate2 = \"1\"\nfutures-util = \"0.3\"\nhttp-body = \"1\"\nurl = \"2\"\nzstd = \"0.13\"\nhyper-util = { version = \"0.1.17\", default-features = false, features = [\"client-legacy\"] }\nlog = { workspace = true }\nmime_guess = \"2.0.5\"\nregex = \"1.11.1\"\nreqwest = { workspace = true, features = [\n \"rustls-tls-manual-roots-no-provider\",\n \"socks\",\n \"http2\",\n \"stream\",\n] }\nserde = { workspace = true, features = [\"derive\"] }\nserde_json = { workspace = true }\nthiserror = { workspace = true }\ntokio = { workspace = true, features = [\"macros\", \"rt\", \"fs\", \"io-util\"] }\ntokio-util = { version = \"0.7\", features = [\"codec\", \"io\", \"io-util\"] }\ntower-service = \"0.3.3\"\nurlencoding = \"2.1.3\"\nyaak-common = { workspace = true }\nyaak-models = { workspace = true }\nyaak-templates = { workspace = true }\nyaak-tls = { workspace = true }\n" }, { "path": "crates/yaak-http/src/chained_reader.rs", "content": "use std::io;\nuse std::pin::Pin;\nuse std::task::{Context, Poll};\nuse tokio::io::{AsyncRead, ReadBuf};\n\n/// A stream that chains multiple AsyncRead sources together\npub(crate) struct ChainedReader {\n readers: Vec,\n current_index: usize,\n current_reader: Option>,\n}\n\n#[derive(Clone)]\npub(crate) enum ReaderType {\n Bytes(Vec),\n FilePath(String),\n}\n\nimpl ChainedReader {\n pub(crate) fn new(readers: Vec) -> Self {\n Self { readers, current_index: 0, current_reader: None }\n }\n}\n\nimpl AsyncRead for ChainedReader {\n fn poll_read(\n mut self: Pin<&mut Self>,\n cx: &mut Context<'_>,\n buf: &mut ReadBuf<'_>,\n ) -> Poll> {\n loop {\n // Try to read from current reader if we have one\n if let Some(ref mut reader) = self.current_reader {\n let before_len = buf.filled().len();\n return match Pin::new(reader).poll_read(cx, buf) {\n Poll::Ready(Ok(())) => {\n if buf.filled().len() == before_len && buf.remaining() > 0 {\n // Current reader is exhausted, move to next\n self.current_reader = None;\n continue;\n }\n Poll::Ready(Ok(()))\n }\n Poll::Ready(Err(e)) => Poll::Ready(Err(e)),\n Poll::Pending => Poll::Pending,\n };\n }\n\n // We need to get the next reader\n if self.current_index >= self.readers.len() {\n // No more readers\n return Poll::Ready(Ok(()));\n }\n\n // Get the next reader\n let reader_type = self.readers[self.current_index].clone();\n self.current_index += 1;\n\n match reader_type {\n ReaderType::Bytes(bytes) => {\n self.current_reader = Some(Box::new(io::Cursor::new(bytes)));\n }\n ReaderType::FilePath(path) => {\n // We need to handle file opening synchronously in poll_read\n // This is a limitation - we'll use blocking file open\n match std::fs::File::open(&path) {\n Ok(file) => {\n // Convert std File to tokio File\n let tokio_file = tokio::fs::File::from_std(file);\n self.current_reader = Some(Box::new(tokio_file));\n }\n Err(e) => return Poll::Ready(Err(e)),\n }\n }\n }\n }\n }\n}\n" }, { "path": "crates/yaak-http/src/client.rs", "content": "use crate::dns::LocalhostResolver;\nuse crate::error::Result;\nuse log::{debug, info, warn};\nuse reqwest::{Client, Proxy, redirect};\nuse std::sync::Arc;\nuse yaak_models::models::DnsOverride;\nuse yaak_tls::{ClientCertificateConfig, get_tls_config};\n\n#[derive(Clone)]\npub struct HttpConnectionProxySettingAuth {\n pub user: String,\n pub password: String,\n}\n\n#[derive(Clone)]\npub enum HttpConnectionProxySetting {\n Disabled,\n System,\n Enabled {\n http: String,\n https: String,\n auth: Option,\n bypass: String,\n },\n}\n\n#[derive(Clone)]\npub struct HttpConnectionOptions {\n pub id: String,\n pub validate_certificates: bool,\n pub proxy: HttpConnectionProxySetting,\n pub client_certificate: Option,\n pub dns_overrides: Vec,\n}\n\nimpl HttpConnectionOptions {\n /// Build a reqwest Client and return it along with the DNS resolver.\n /// The resolver is returned separately so it can be configured per-request\n /// to emit DNS timing events to the appropriate channel.\n pub(crate) fn build_client(&self) -> Result<(Client, Arc)> {\n let mut client = Client::builder()\n .connection_verbose(true)\n .redirect(redirect::Policy::none())\n // Decompression is handled by HttpTransaction, not reqwest\n .no_gzip()\n .no_brotli()\n .no_deflate()\n .referer(false)\n .tls_info(true)\n // Disable connection pooling to ensure DNS resolution happens on each request\n // This is needed so we can emit DNS timing events for each request\n .pool_max_idle_per_host(0);\n\n // Configure TLS with optional client certificate\n let config =\n get_tls_config(self.validate_certificates, true, self.client_certificate.clone())?;\n client = client.use_preconfigured_tls(config);\n\n // Configure DNS resolver - keep a reference to configure per-request\n let resolver = LocalhostResolver::new(self.dns_overrides.clone());\n client = client.dns_resolver(resolver.clone());\n\n // Configure proxy\n match self.proxy.clone() {\n HttpConnectionProxySetting::System => { /* Default */ }\n HttpConnectionProxySetting::Disabled => {\n client = client.no_proxy();\n }\n HttpConnectionProxySetting::Enabled { http, https, auth, bypass } => {\n for p in build_enabled_proxy(http, https, auth, bypass) {\n client = client.proxy(p)\n }\n }\n }\n\n info!(\n \"Building new HTTP client validate_certificates={} client_cert={}\",\n self.validate_certificates,\n self.client_certificate.is_some()\n );\n\n Ok((client.build()?, resolver))\n }\n}\n\nfn build_enabled_proxy(\n http: String,\n https: String,\n auth: Option,\n bypass: String,\n) -> Vec {\n debug!(\"Using proxy http={http} https={https} bypass={bypass}\");\n\n let mut proxies = Vec::new();\n\n if !http.is_empty() {\n match Proxy::http(http) {\n Ok(mut proxy) => {\n if let Some(HttpConnectionProxySettingAuth { user, password }) = auth.clone() {\n debug!(\"Using http proxy auth\");\n proxy = proxy.basic_auth(user.as_str(), password.as_str());\n }\n proxies.push(proxy.no_proxy(reqwest::NoProxy::from_string(&bypass)));\n }\n Err(e) => {\n warn!(\"Failed to apply http proxy {e:?}\");\n }\n };\n }\n\n if !https.is_empty() {\n match Proxy::https(https) {\n Ok(mut proxy) => {\n if let Some(HttpConnectionProxySettingAuth { user, password }) = auth {\n debug!(\"Using https proxy auth\");\n proxy = proxy.basic_auth(user.as_str(), password.as_str());\n }\n proxies.push(proxy.no_proxy(reqwest::NoProxy::from_string(&bypass)));\n }\n Err(e) => {\n warn!(\"Failed to apply https proxy {e:?}\");\n }\n };\n }\n\n proxies\n}\n" }, { "path": "crates/yaak-http/src/cookies.rs", "content": "//! Custom cookie handling for HTTP requests\n//!\n//! This module provides cookie storage and matching functionality that was previously\n//! delegated to reqwest. It implements RFC 6265 cookie domain and path matching.\n\nuse log::debug;\nuse std::sync::{Arc, Mutex};\nuse std::time::{Duration, SystemTime, UNIX_EPOCH};\nuse url::Url;\nuse yaak_models::models::{Cookie, CookieDomain, CookieExpires};\n\n/// A thread-safe cookie store that can be shared across requests\n#[derive(Debug, Clone)]\npub struct CookieStore {\n cookies: Arc>>,\n}\n\nimpl Default for CookieStore {\n fn default() -> Self {\n Self::new()\n }\n}\n\nimpl CookieStore {\n /// Create a new empty cookie store\n pub fn new() -> Self {\n Self { cookies: Arc::new(Mutex::new(Vec::new())) }\n }\n\n /// Create a cookie store from existing cookies\n pub fn from_cookies(cookies: Vec) -> Self {\n Self { cookies: Arc::new(Mutex::new(cookies)) }\n }\n\n /// Get all cookies (for persistence)\n pub fn get_all_cookies(&self) -> Vec {\n self.cookies.lock().unwrap().clone()\n }\n\n /// Get the Cookie header value for the given URL\n pub fn get_cookie_header(&self, url: &Url) -> Option {\n let cookies = self.cookies.lock().unwrap();\n let now = SystemTime::now();\n\n let matching_cookies: Vec<_> = cookies\n .iter()\n .filter(|cookie| self.cookie_matches(cookie, url, &now))\n .filter_map(|cookie| {\n // Parse the raw cookie to get name=value\n parse_cookie_name_value(&cookie.raw_cookie)\n })\n .collect();\n\n if matching_cookies.is_empty() {\n None\n } else {\n Some(\n matching_cookies\n .into_iter()\n .map(|(name, value)| format!(\"{}={}\", name, value))\n .collect::>()\n .join(\"; \"),\n )\n }\n }\n\n /// Parse Set-Cookie headers and add cookies to the store\n pub fn store_cookies_from_response(&self, url: &Url, set_cookie_headers: &[String]) {\n let mut cookies = self.cookies.lock().unwrap();\n\n for header_value in set_cookie_headers {\n if let Some(cookie) = parse_set_cookie(header_value, url) {\n // Remove any existing cookie with the same name and domain\n cookies.retain(|existing| !cookies_match(existing, &cookie));\n debug!(\n \"Storing cookie: {} for domain {:?}\",\n parse_cookie_name_value(&cookie.raw_cookie)\n .map(|(n, _)| n)\n .unwrap_or_else(|| \"unknown\".to_string()),\n cookie.domain\n );\n cookies.push(cookie);\n }\n }\n }\n\n /// Check if a cookie matches the given URL\n fn cookie_matches(&self, cookie: &Cookie, url: &Url, now: &SystemTime) -> bool {\n // Check expiration\n if let CookieExpires::AtUtc(expiry_str) = &cookie.expires {\n if let Ok(expiry) = parse_cookie_date(expiry_str) {\n if expiry < *now {\n return false;\n }\n }\n }\n\n // Check domain\n let url_host = match url.host_str() {\n Some(h) => h.to_lowercase(),\n None => return false,\n };\n\n let domain_matches = match &cookie.domain {\n CookieDomain::HostOnly(domain) => url_host == domain.to_lowercase(),\n CookieDomain::Suffix(domain) => {\n let domain_lower = domain.to_lowercase();\n url_host == domain_lower || url_host.ends_with(&format!(\".{}\", domain_lower))\n }\n // NotPresent and Empty should never occur in practice since we always set domain\n // when parsing Set-Cookie headers. Treat as non-matching to be safe.\n CookieDomain::NotPresent | CookieDomain::Empty => false,\n };\n\n if !domain_matches {\n return false;\n }\n\n // Check path\n let (cookie_path, _) = &cookie.path;\n let url_path = url.path();\n\n path_matches(url_path, cookie_path)\n }\n}\n\n/// Parse name=value from a cookie string (raw_cookie format)\nfn parse_cookie_name_value(raw_cookie: &str) -> Option<(String, String)> {\n // The raw_cookie typically looks like \"name=value\" or \"name=value; attr1; attr2=...\"\n let first_part = raw_cookie.split(';').next()?;\n let mut parts = first_part.splitn(2, '=');\n let name = parts.next()?.trim().to_string();\n let value = parts.next().unwrap_or(\"\").trim().to_string();\n\n if name.is_empty() { None } else { Some((name, value)) }\n}\n\n/// Parse a Set-Cookie header into a Cookie\nfn parse_set_cookie(header_value: &str, request_url: &Url) -> Option {\n let parsed = cookie::Cookie::parse(header_value).ok()?;\n\n let raw_cookie = format!(\"{}={}\", parsed.name(), parsed.value());\n\n // Determine domain\n let domain = if let Some(domain_attr) = parsed.domain() {\n // Domain attribute present - this is a suffix match\n let domain = domain_attr.trim_start_matches('.').to_lowercase();\n\n // Reject single-component domains (TLDs) except localhost\n if is_single_component_domain(&domain) && !is_localhost(&domain) {\n debug!(\"Rejecting cookie with single-component domain: {}\", domain);\n return None;\n }\n\n CookieDomain::Suffix(domain)\n } else {\n // No domain attribute - host-only cookie\n CookieDomain::HostOnly(request_url.host_str().unwrap_or(\"\").to_lowercase())\n };\n\n // Determine expiration\n let expires = if let Some(max_age) = parsed.max_age() {\n let duration = Duration::from_secs(max_age.whole_seconds().max(0) as u64);\n let expiry = SystemTime::now() + duration;\n let expiry_secs = expiry.duration_since(UNIX_EPOCH).unwrap_or_default().as_secs();\n CookieExpires::AtUtc(format!(\"{}\", expiry_secs))\n } else if let Some(expires_time) = parsed.expires() {\n match expires_time {\n cookie::Expiration::DateTime(dt) => {\n let timestamp = dt.unix_timestamp();\n CookieExpires::AtUtc(format!(\"{}\", timestamp))\n }\n cookie::Expiration::Session => CookieExpires::SessionEnd,\n }\n } else {\n CookieExpires::SessionEnd\n };\n\n // Determine path\n let path = if let Some(path_attr) = parsed.path() {\n (path_attr.to_string(), true)\n } else {\n // Default path is the directory of the request URI\n let default_path = default_cookie_path(request_url.path());\n (default_path, false)\n };\n\n Some(Cookie { raw_cookie, domain, expires, path })\n}\n\n/// Get the default cookie path from a request path (RFC 6265 Section 5.1.4)\nfn default_cookie_path(request_path: &str) -> String {\n if request_path.is_empty() || !request_path.starts_with('/') {\n return \"/\".to_string();\n }\n\n // Find the last slash\n if let Some(last_slash) = request_path.rfind('/') {\n if last_slash == 0 { \"/\".to_string() } else { request_path[..last_slash].to_string() }\n } else {\n \"/\".to_string()\n }\n}\n\n/// Check if a request path matches a cookie path (RFC 6265 Section 5.1.4)\nfn path_matches(request_path: &str, cookie_path: &str) -> bool {\n if request_path == cookie_path {\n return true;\n }\n\n if request_path.starts_with(cookie_path) {\n // Cookie path must end with / or the char after cookie_path in request_path must be /\n if cookie_path.ends_with('/') {\n return true;\n }\n if request_path.chars().nth(cookie_path.len()) == Some('/') {\n return true;\n }\n }\n\n false\n}\n\n/// Check if two cookies match (same name and domain)\nfn cookies_match(a: &Cookie, b: &Cookie) -> bool {\n let name_a = parse_cookie_name_value(&a.raw_cookie).map(|(n, _)| n);\n let name_b = parse_cookie_name_value(&b.raw_cookie).map(|(n, _)| n);\n\n if name_a != name_b {\n return false;\n }\n\n // Check domain match\n match (&a.domain, &b.domain) {\n (CookieDomain::HostOnly(d1), CookieDomain::HostOnly(d2)) => {\n d1.to_lowercase() == d2.to_lowercase()\n }\n (CookieDomain::Suffix(d1), CookieDomain::Suffix(d2)) => {\n d1.to_lowercase() == d2.to_lowercase()\n }\n _ => false,\n }\n}\n\n/// Parse a cookie date string (Unix timestamp in our format)\nfn parse_cookie_date(date_str: &str) -> Result {\n let timestamp: i64 = date_str.parse().map_err(|_| ())?;\n let duration = Duration::from_secs(timestamp.max(0) as u64);\n Ok(UNIX_EPOCH + duration)\n}\n\n/// Check if a domain is a single-component domain (TLD)\n/// e.g., \"com\", \"org\", \"net\" - domains without any dots\nfn is_single_component_domain(domain: &str) -> bool {\n // Empty or only dots\n let trimmed = domain.trim_matches('.');\n if trimmed.is_empty() {\n return true;\n }\n // IPv6 addresses use colons, not dots - don't consider them single-component\n if domain.contains(':') {\n return false;\n }\n !trimmed.contains('.')\n}\n\n/// Check if a domain is localhost or a localhost variant\nfn is_localhost(domain: &str) -> bool {\n let lower = domain.to_lowercase();\n lower == \"localhost\"\n || lower.ends_with(\".localhost\")\n || lower == \"127.0.0.1\"\n || lower == \"::1\"\n || lower == \"[::1]\"\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n\n #[test]\n fn test_parse_cookie_name_value() {\n assert_eq!(\n parse_cookie_name_value(\"session=abc123\"),\n Some((\"session\".to_string(), \"abc123\".to_string()))\n );\n assert_eq!(\n parse_cookie_name_value(\"name=value; Path=/; HttpOnly\"),\n Some((\"name\".to_string(), \"value\".to_string()))\n );\n assert_eq!(parse_cookie_name_value(\"empty=\"), Some((\"empty\".to_string(), \"\".to_string())));\n assert_eq!(parse_cookie_name_value(\"\"), None);\n }\n\n #[test]\n fn test_path_matches() {\n assert!(path_matches(\"/\", \"/\"));\n assert!(path_matches(\"/foo\", \"/\"));\n assert!(path_matches(\"/foo/bar\", \"/foo\"));\n assert!(path_matches(\"/foo/bar\", \"/foo/\"));\n assert!(!path_matches(\"/foobar\", \"/foo\"));\n assert!(!path_matches(\"/foo\", \"/foo/bar\"));\n }\n\n #[test]\n fn test_default_cookie_path() {\n assert_eq!(default_cookie_path(\"/\"), \"/\");\n assert_eq!(default_cookie_path(\"/foo\"), \"/\");\n assert_eq!(default_cookie_path(\"/foo/bar\"), \"/foo\");\n assert_eq!(default_cookie_path(\"/foo/bar/baz\"), \"/foo/bar\");\n assert_eq!(default_cookie_path(\"\"), \"/\");\n }\n\n #[test]\n fn test_cookie_store_basic() {\n let store = CookieStore::new();\n let url = Url::parse(\"https://example.com/path\").unwrap();\n\n // Initially empty\n assert!(store.get_cookie_header(&url).is_none());\n\n // Add a cookie\n store.store_cookies_from_response(&url, &[\"session=abc123\".to_string()]);\n\n // Should now have the cookie\n let header = store.get_cookie_header(&url);\n assert_eq!(header, Some(\"session=abc123\".to_string()));\n }\n\n #[test]\n fn test_cookie_domain_matching() {\n let store = CookieStore::new();\n let url = Url::parse(\"https://example.com/\").unwrap();\n\n // Cookie with domain attribute (suffix match)\n store.store_cookies_from_response(\n &url,\n &[\"domain_cookie=value; Domain=example.com\".to_string()],\n );\n\n // Should match example.com\n assert!(store.get_cookie_header(&url).is_some());\n\n // Should match subdomain\n let subdomain_url = Url::parse(\"https://sub.example.com/\").unwrap();\n assert!(store.get_cookie_header(&subdomain_url).is_some());\n\n // Should not match different domain\n let other_url = Url::parse(\"https://other.com/\").unwrap();\n assert!(store.get_cookie_header(&other_url).is_none());\n }\n\n #[test]\n fn test_cookie_path_matching() {\n let store = CookieStore::new();\n let url = Url::parse(\"https://example.com/api/v1\").unwrap();\n\n // Cookie with path\n store.store_cookies_from_response(&url, &[\"api_cookie=value; Path=/api\".to_string()]);\n\n // Should match /api/v1\n assert!(store.get_cookie_header(&url).is_some());\n\n // Should match /api\n let api_url = Url::parse(\"https://example.com/api\").unwrap();\n assert!(store.get_cookie_header(&api_url).is_some());\n\n // Should not match /other\n let other_url = Url::parse(\"https://example.com/other\").unwrap();\n assert!(store.get_cookie_header(&other_url).is_none());\n }\n\n #[test]\n fn test_cookie_replacement() {\n let store = CookieStore::new();\n let url = Url::parse(\"https://example.com/\").unwrap();\n\n // Add a cookie\n store.store_cookies_from_response(&url, &[\"session=old\".to_string()]);\n assert_eq!(store.get_cookie_header(&url), Some(\"session=old\".to_string()));\n\n // Replace with new value\n store.store_cookies_from_response(&url, &[\"session=new\".to_string()]);\n assert_eq!(store.get_cookie_header(&url), Some(\"session=new\".to_string()));\n\n // Should only have one cookie\n assert_eq!(store.get_all_cookies().len(), 1);\n }\n\n #[test]\n fn test_is_single_component_domain() {\n // Single-component domains (TLDs)\n assert!(is_single_component_domain(\"com\"));\n assert!(is_single_component_domain(\"org\"));\n assert!(is_single_component_domain(\"net\"));\n assert!(is_single_component_domain(\"localhost\")); // Still single-component, but allowed separately\n\n // Multi-component domains\n assert!(!is_single_component_domain(\"example.com\"));\n assert!(!is_single_component_domain(\"sub.example.com\"));\n assert!(!is_single_component_domain(\"co.uk\"));\n\n // Edge cases\n assert!(is_single_component_domain(\"\")); // Empty is treated as single-component\n assert!(is_single_component_domain(\".\")); // Only dots\n assert!(is_single_component_domain(\"..\")); // Only dots\n\n // IPv6 addresses (have colons, not dots)\n assert!(!is_single_component_domain(\"::1\")); // IPv6 localhost\n assert!(!is_single_component_domain(\"[::1]\")); // Bracketed IPv6\n assert!(!is_single_component_domain(\"2001:db8::1\")); // IPv6 address\n }\n\n #[test]\n fn test_is_localhost() {\n // Localhost variants\n assert!(is_localhost(\"localhost\"));\n assert!(is_localhost(\"LOCALHOST\")); // Case-insensitive\n assert!(is_localhost(\"sub.localhost\"));\n assert!(is_localhost(\"app.sub.localhost\"));\n\n // IP localhost\n assert!(is_localhost(\"127.0.0.1\"));\n assert!(is_localhost(\"::1\"));\n assert!(is_localhost(\"[::1]\"));\n\n // Not localhost\n assert!(!is_localhost(\"example.com\"));\n assert!(!is_localhost(\"localhost.com\")); // .com domain, not localhost\n assert!(!is_localhost(\"notlocalhost\"));\n }\n\n #[test]\n fn test_reject_tld_cookies() {\n let store = CookieStore::new();\n let url = Url::parse(\"https://example.com/\").unwrap();\n\n // Try to set a cookie with Domain=com (TLD)\n store.store_cookies_from_response(&url, &[\"bad=cookie; Domain=com\".to_string()]);\n\n // Should be rejected - no cookies stored\n assert_eq!(store.get_all_cookies().len(), 0);\n assert!(store.get_cookie_header(&url).is_none());\n }\n\n #[test]\n fn test_allow_localhost_cookies() {\n let store = CookieStore::new();\n let url = Url::parse(\"http://localhost:3000/\").unwrap();\n\n // Cookie with Domain=localhost should be allowed\n store.store_cookies_from_response(&url, &[\"session=abc; Domain=localhost\".to_string()]);\n\n // Should be accepted\n assert_eq!(store.get_all_cookies().len(), 1);\n assert!(store.get_cookie_header(&url).is_some());\n }\n\n #[test]\n fn test_allow_127_0_0_1_cookies() {\n let store = CookieStore::new();\n let url = Url::parse(\"http://127.0.0.1:8080/\").unwrap();\n\n // Cookie without Domain attribute (host-only) should work\n store.store_cookies_from_response(&url, &[\"session=xyz\".to_string()]);\n\n // Should be accepted\n assert_eq!(store.get_all_cookies().len(), 1);\n assert!(store.get_cookie_header(&url).is_some());\n }\n\n #[test]\n fn test_allow_normal_domain_cookies() {\n let store = CookieStore::new();\n let url = Url::parse(\"https://example.com/\").unwrap();\n\n // Cookie with valid domain should be allowed\n store.store_cookies_from_response(&url, &[\"session=abc; Domain=example.com\".to_string()]);\n\n // Should be accepted\n assert_eq!(store.get_all_cookies().len(), 1);\n assert!(store.get_cookie_header(&url).is_some());\n }\n}\n" }, { "path": "crates/yaak-http/src/decompress.rs", "content": "use crate::error::{Error, Result};\nuse async_compression::tokio::bufread::{\n BrotliDecoder, DeflateDecoder as AsyncDeflateDecoder, GzipDecoder,\n ZstdDecoder as AsyncZstdDecoder,\n};\nuse flate2::read::{DeflateDecoder, GzDecoder};\nuse std::io::Read;\nuse tokio::io::{AsyncBufRead, AsyncRead};\n\n/// Supported compression encodings\n#[derive(Debug, Clone, Copy, PartialEq, Eq)]\npub enum ContentEncoding {\n Gzip,\n Deflate,\n Brotli,\n Zstd,\n Identity,\n}\n\nimpl ContentEncoding {\n /// Parse a Content-Encoding header value into an encoding type.\n /// Returns Identity for unknown or missing encodings.\n pub fn from_header(value: Option<&str>) -> Self {\n match value.map(|s| s.trim().to_lowercase()).as_deref() {\n Some(\"gzip\") | Some(\"x-gzip\") => ContentEncoding::Gzip,\n Some(\"deflate\") => ContentEncoding::Deflate,\n Some(\"br\") => ContentEncoding::Brotli,\n Some(\"zstd\") => ContentEncoding::Zstd,\n _ => ContentEncoding::Identity,\n }\n }\n}\n\n/// Result of decompression, containing both the decompressed data and size info\n#[derive(Debug)]\npub struct DecompressResult {\n pub data: Vec,\n pub compressed_size: u64,\n pub decompressed_size: u64,\n}\n\n/// Decompress data based on the Content-Encoding.\n/// Returns the original data unchanged if encoding is Identity or unknown.\npub fn decompress(data: Vec, encoding: ContentEncoding) -> Result {\n let compressed_size = data.len() as u64;\n\n let decompressed = match encoding {\n ContentEncoding::Identity => data,\n ContentEncoding::Gzip => decompress_gzip(&data)?,\n ContentEncoding::Deflate => decompress_deflate(&data)?,\n ContentEncoding::Brotli => decompress_brotli(&data)?,\n ContentEncoding::Zstd => decompress_zstd(&data)?,\n };\n\n let decompressed_size = decompressed.len() as u64;\n\n Ok(DecompressResult { data: decompressed, compressed_size, decompressed_size })\n}\n\nfn decompress_gzip(data: &[u8]) -> Result> {\n let mut decoder = GzDecoder::new(data);\n let mut decompressed = Vec::new();\n decoder\n .read_to_end(&mut decompressed)\n .map_err(|e| Error::DecompressionError(format!(\"gzip decompression failed: {}\", e)))?;\n Ok(decompressed)\n}\n\nfn decompress_deflate(data: &[u8]) -> Result> {\n let mut decoder = DeflateDecoder::new(data);\n let mut decompressed = Vec::new();\n decoder\n .read_to_end(&mut decompressed)\n .map_err(|e| Error::DecompressionError(format!(\"deflate decompression failed: {}\", e)))?;\n Ok(decompressed)\n}\n\nfn decompress_brotli(data: &[u8]) -> Result> {\n let mut decompressed = Vec::new();\n brotli::BrotliDecompress(&mut std::io::Cursor::new(data), &mut decompressed)\n .map_err(|e| Error::DecompressionError(format!(\"brotli decompression failed: {}\", e)))?;\n Ok(decompressed)\n}\n\nfn decompress_zstd(data: &[u8]) -> Result> {\n zstd::stream::decode_all(std::io::Cursor::new(data))\n .map_err(|e| Error::DecompressionError(format!(\"zstd decompression failed: {}\", e)))\n}\n\n/// Create a streaming decompressor that wraps an async reader.\n/// Returns an AsyncRead that decompresses data on-the-fly.\npub fn streaming_decoder(\n reader: R,\n encoding: ContentEncoding,\n) -> Box {\n match encoding {\n ContentEncoding::Identity => Box::new(reader),\n ContentEncoding::Gzip => Box::new(GzipDecoder::new(reader)),\n ContentEncoding::Deflate => Box::new(AsyncDeflateDecoder::new(reader)),\n ContentEncoding::Brotli => Box::new(BrotliDecoder::new(reader)),\n ContentEncoding::Zstd => Box::new(AsyncZstdDecoder::new(reader)),\n }\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n use flate2::Compression;\n use flate2::write::GzEncoder;\n use std::io::Write;\n\n #[test]\n fn test_content_encoding_from_header() {\n assert_eq!(ContentEncoding::from_header(Some(\"gzip\")), ContentEncoding::Gzip);\n assert_eq!(ContentEncoding::from_header(Some(\"x-gzip\")), ContentEncoding::Gzip);\n assert_eq!(ContentEncoding::from_header(Some(\"GZIP\")), ContentEncoding::Gzip);\n assert_eq!(ContentEncoding::from_header(Some(\"deflate\")), ContentEncoding::Deflate);\n assert_eq!(ContentEncoding::from_header(Some(\"br\")), ContentEncoding::Brotli);\n assert_eq!(ContentEncoding::from_header(Some(\"zstd\")), ContentEncoding::Zstd);\n assert_eq!(ContentEncoding::from_header(Some(\"identity\")), ContentEncoding::Identity);\n assert_eq!(ContentEncoding::from_header(Some(\"unknown\")), ContentEncoding::Identity);\n assert_eq!(ContentEncoding::from_header(None), ContentEncoding::Identity);\n }\n\n #[test]\n fn test_decompress_identity() {\n let data = b\"hello world\".to_vec();\n let result = decompress(data.clone(), ContentEncoding::Identity).unwrap();\n assert_eq!(result.data, data);\n assert_eq!(result.compressed_size, 11);\n assert_eq!(result.decompressed_size, 11);\n }\n\n #[test]\n fn test_decompress_gzip() {\n // Compress some data with gzip\n let original = b\"hello world, this is a test of gzip compression\";\n let mut encoder = GzEncoder::new(Vec::new(), Compression::default());\n encoder.write_all(original).unwrap();\n let compressed = encoder.finish().unwrap();\n\n let result = decompress(compressed.clone(), ContentEncoding::Gzip).unwrap();\n assert_eq!(result.data, original);\n assert_eq!(result.compressed_size, compressed.len() as u64);\n assert_eq!(result.decompressed_size, original.len() as u64);\n }\n\n #[test]\n fn test_decompress_deflate() {\n // Compress some data with deflate\n let original = b\"hello world, this is a test of deflate compression\";\n let mut encoder = flate2::write::DeflateEncoder::new(Vec::new(), Compression::default());\n encoder.write_all(original).unwrap();\n let compressed = encoder.finish().unwrap();\n\n let result = decompress(compressed.clone(), ContentEncoding::Deflate).unwrap();\n assert_eq!(result.data, original);\n assert_eq!(result.compressed_size, compressed.len() as u64);\n assert_eq!(result.decompressed_size, original.len() as u64);\n }\n\n #[test]\n fn test_decompress_brotli() {\n // Compress some data with brotli\n let original = b\"hello world, this is a test of brotli compression\";\n let mut compressed = Vec::new();\n let mut writer = brotli::CompressorWriter::new(&mut compressed, 4096, 4, 22);\n writer.write_all(original).unwrap();\n drop(writer);\n\n let result = decompress(compressed.clone(), ContentEncoding::Brotli).unwrap();\n assert_eq!(result.data, original);\n assert_eq!(result.compressed_size, compressed.len() as u64);\n assert_eq!(result.decompressed_size, original.len() as u64);\n }\n\n #[test]\n fn test_decompress_zstd() {\n // Compress some data with zstd\n let original = b\"hello world, this is a test of zstd compression\";\n let compressed = zstd::stream::encode_all(std::io::Cursor::new(original), 3).unwrap();\n\n let result = decompress(compressed.clone(), ContentEncoding::Zstd).unwrap();\n assert_eq!(result.data, original);\n assert_eq!(result.compressed_size, compressed.len() as u64);\n assert_eq!(result.decompressed_size, original.len() as u64);\n }\n}\n" }, { "path": "crates/yaak-http/src/dns.rs", "content": "use crate::sender::HttpResponseEvent;\nuse hyper_util::client::legacy::connect::dns::{\n GaiResolver as HyperGaiResolver, Name as HyperName,\n};\nuse log::info;\nuse reqwest::dns::{Addrs, Name, Resolve, Resolving};\nuse std::collections::HashMap;\nuse std::net::{IpAddr, Ipv4Addr, Ipv6Addr, SocketAddr};\nuse std::str::FromStr;\nuse std::sync::Arc;\nuse std::time::Instant;\nuse tokio::sync::{RwLock, mpsc};\nuse tower_service::Service;\nuse yaak_models::models::DnsOverride;\n\n/// Stores resolved addresses for a hostname override\n#[derive(Clone)]\npub struct ResolvedOverride {\n pub ipv4: Vec,\n pub ipv6: Vec,\n}\n\n#[derive(Clone)]\npub struct LocalhostResolver {\n fallback: HyperGaiResolver,\n event_tx: Arc>>>,\n overrides: Arc>,\n}\n\nimpl LocalhostResolver {\n pub fn new(dns_overrides: Vec) -> Arc {\n let resolver = HyperGaiResolver::new();\n\n // Pre-parse DNS overrides into a lookup map\n let mut overrides = HashMap::new();\n for o in dns_overrides {\n if !o.enabled {\n continue;\n }\n let hostname = o.hostname.to_lowercase();\n\n let ipv4: Vec =\n o.ipv4.iter().filter_map(|s| s.parse::().ok()).collect();\n\n let ipv6: Vec =\n o.ipv6.iter().filter_map(|s| s.parse::().ok()).collect();\n\n // Only add if at least one address is valid\n if !ipv4.is_empty() || !ipv6.is_empty() {\n overrides.insert(hostname, ResolvedOverride { ipv4, ipv6 });\n }\n }\n\n Arc::new(Self {\n fallback: resolver,\n event_tx: Arc::new(RwLock::new(None)),\n overrides: Arc::new(overrides),\n })\n }\n\n /// Set the event sender for the current request.\n /// This should be called before each request to direct DNS events\n /// to the appropriate channel.\n pub async fn set_event_sender(&self, tx: Option>) {\n let mut guard = self.event_tx.write().await;\n *guard = tx;\n }\n}\n\nimpl Resolve for LocalhostResolver {\n fn resolve(&self, name: Name) -> Resolving {\n let host = name.as_str().to_lowercase();\n let event_tx = self.event_tx.clone();\n let overrides = self.overrides.clone();\n\n info!(\"DNS resolve called for: {}\", host);\n\n // Check for DNS override first\n if let Some(resolved) = overrides.get(&host) {\n log::debug!(\"DNS override found for: {}\", host);\n let hostname = host.clone();\n let mut addrs: Vec = Vec::new();\n\n // Add IPv4 addresses\n for ip in &resolved.ipv4 {\n addrs.push(SocketAddr::new(IpAddr::V4(*ip), 0));\n }\n\n // Add IPv6 addresses\n for ip in &resolved.ipv6 {\n addrs.push(SocketAddr::new(IpAddr::V6(*ip), 0));\n }\n\n let addresses: Vec = addrs.iter().map(|a| a.ip().to_string()).collect();\n\n return Box::pin(async move {\n // Emit DNS event for override\n let guard = event_tx.read().await;\n if let Some(tx) = guard.as_ref() {\n let _ = tx\n .send(HttpResponseEvent::DnsResolved {\n hostname,\n addresses,\n duration: 0,\n overridden: true,\n })\n .await;\n }\n\n Ok::>(Box::new(addrs.into_iter()))\n });\n }\n\n // Check for .localhost suffix\n let is_localhost = host.ends_with(\".localhost\");\n if is_localhost {\n let hostname = host.clone();\n // Port 0 is fine; reqwest replaces it with the URL's explicit\n // port or the scheme's default (80/443, etc.).\n let addrs: Vec = vec![\n SocketAddr::new(IpAddr::V4(Ipv4Addr::LOCALHOST), 0),\n SocketAddr::new(IpAddr::V6(Ipv6Addr::LOCALHOST), 0),\n ];\n\n let addresses: Vec = addrs.iter().map(|a| a.ip().to_string()).collect();\n\n return Box::pin(async move {\n // Emit DNS event for localhost resolution\n let guard = event_tx.read().await;\n if let Some(tx) = guard.as_ref() {\n let _ = tx\n .send(HttpResponseEvent::DnsResolved {\n hostname,\n addresses,\n duration: 0,\n overridden: false,\n })\n .await;\n }\n\n Ok::>(Box::new(addrs.into_iter()))\n });\n }\n\n // Fall back to system DNS\n let mut fallback = self.fallback.clone();\n let name_str = name.as_str().to_string();\n let hostname = host.clone();\n\n Box::pin(async move {\n let start = Instant::now();\n\n let result = match HyperName::from_str(&name_str) {\n Ok(n) => fallback.call(n).await,\n Err(e) => return Err(Box::new(e) as Box),\n };\n\n let duration = start.elapsed().as_millis() as u64;\n\n match result {\n Ok(addrs) => {\n // Collect addresses for event emission\n let addr_vec: Vec = addrs.collect();\n let addresses: Vec =\n addr_vec.iter().map(|a| a.ip().to_string()).collect();\n\n // Emit DNS event\n let guard = event_tx.read().await;\n if let Some(tx) = guard.as_ref() {\n let _ = tx\n .send(HttpResponseEvent::DnsResolved {\n hostname,\n addresses,\n duration,\n overridden: false,\n })\n .await;\n }\n\n Ok(Box::new(addr_vec.into_iter()) as Addrs)\n }\n Err(err) => Err(Box::new(err) as Box),\n }\n })\n }\n}\n" }, { "path": "crates/yaak-http/src/error.rs", "content": "use serde::{Serialize, Serializer};\nuse thiserror::Error;\n\n#[derive(Error, Debug)]\npub enum Error {\n #[error(\"Client error: {0:?}\")]\n Client(#[from] reqwest::Error),\n\n #[error(transparent)]\n TlsError(#[from] yaak_tls::error::Error),\n\n #[error(\"Request failed with {0:?}\")]\n RequestError(String),\n\n #[error(\"Request canceled\")]\n RequestCanceledError,\n\n #[error(\"Timeout of {0:?} reached\")]\n RequestTimeout(std::time::Duration),\n\n #[error(\"Decompression error: {0}\")]\n DecompressionError(String),\n\n #[error(\"Failed to read response body: {0}\")]\n BodyReadError(String),\n}\n\nimpl Serialize for Error {\n fn serialize(&self, serializer: S) -> std::result::Result\n where\n S: Serializer,\n {\n serializer.serialize_str(self.to_string().as_ref())\n }\n}\n\npub type Result = std::result::Result;\n" }, { "path": "crates/yaak-http/src/lib.rs", "content": "mod chained_reader;\npub mod client;\npub mod cookies;\npub mod decompress;\npub mod dns;\npub mod error;\npub mod manager;\npub mod path_placeholders;\nmod proto;\npub mod sender;\npub mod tee_reader;\npub mod transaction;\npub mod types;\n" }, { "path": "crates/yaak-http/src/manager.rs", "content": "use crate::client::HttpConnectionOptions;\nuse crate::dns::LocalhostResolver;\nuse crate::error::Result;\nuse reqwest::Client;\nuse std::collections::BTreeMap;\nuse std::sync::Arc;\nuse std::time::{Duration, Instant};\nuse tokio::sync::RwLock;\n\n/// A cached HTTP client along with its DNS resolver.\n/// The resolver is needed to set the event sender per-request.\npub struct CachedClient {\n pub client: Client,\n pub resolver: Arc,\n}\n\npub struct HttpConnectionManager {\n connections: Arc>>,\n ttl: Duration,\n}\n\nimpl HttpConnectionManager {\n pub fn new() -> Self {\n Self {\n connections: Arc::new(RwLock::new(BTreeMap::new())),\n ttl: Duration::from_secs(10 * 60),\n }\n }\n\n pub async fn get_client(&self, opt: &HttpConnectionOptions) -> Result {\n let mut connections = self.connections.write().await;\n let id = opt.id.clone();\n\n // Clean old connections\n connections.retain(|_, (_, last_used)| last_used.elapsed() <= self.ttl);\n\n if let Some((cached, last_used)) = connections.get_mut(&id) {\n *last_used = Instant::now();\n return Ok(CachedClient {\n client: cached.client.clone(),\n resolver: cached.resolver.clone(),\n });\n }\n\n let (client, resolver) = opt.build_client()?;\n let cached = CachedClient { client: client.clone(), resolver: resolver.clone() };\n connections.insert(id.into(), (cached, Instant::now()));\n\n Ok(CachedClient { client, resolver })\n }\n}\n" }, { "path": "crates/yaak-http/src/path_placeholders.rs", "content": "use yaak_models::models::HttpUrlParameter;\n\npub fn apply_path_placeholders(\n url: &str,\n parameters: &Vec,\n) -> (String, Vec) {\n let mut new_parameters = Vec::new();\n\n let mut url = url.to_string();\n for p in parameters {\n if !p.enabled || p.name.is_empty() {\n continue;\n }\n\n // Replace path parameters with values from URL parameters\n let old_url_string = url.clone();\n url = replace_path_placeholder(&p, url.as_str());\n\n // Remove as param if it modified the URL\n if old_url_string == *url {\n new_parameters.push(p.to_owned());\n }\n }\n\n (url, new_parameters)\n}\n\nfn replace_path_placeholder(p: &HttpUrlParameter, url: &str) -> String {\n if !p.enabled {\n return url.to_string();\n }\n\n if !p.name.starts_with(\":\") {\n return url.to_string();\n }\n\n let re = regex::Regex::new(format!(\"(/){}([/?#]|$)\", p.name).as_str()).unwrap();\n let result = re\n .replace_all(url, |cap: ®ex::Captures| {\n format!(\n \"{}{}{}\",\n cap[1].to_string(),\n urlencoding::encode(p.value.as_str()),\n cap[2].to_string()\n )\n })\n .into_owned();\n result\n}\n\n#[cfg(test)]\nmod placeholder_tests {\n use crate::path_placeholders::{apply_path_placeholders, replace_path_placeholder};\n use yaak_models::models::{HttpRequest, HttpUrlParameter};\n\n #[test]\n fn placeholder_middle() {\n let p =\n HttpUrlParameter { name: \":foo\".into(), value: \"xxx\".into(), enabled: true, id: None };\n assert_eq!(\n replace_path_placeholder(&p, \"https://example.com/:foo/bar\"),\n \"https://example.com/xxx/bar\",\n );\n }\n\n #[test]\n fn placeholder_end() {\n let p =\n HttpUrlParameter { name: \":foo\".into(), value: \"xxx\".into(), enabled: true, id: None };\n assert_eq!(\n replace_path_placeholder(&p, \"https://example.com/:foo\"),\n \"https://example.com/xxx\",\n );\n }\n\n #[test]\n fn placeholder_query() {\n let p =\n HttpUrlParameter { name: \":foo\".into(), value: \"xxx\".into(), enabled: true, id: None };\n assert_eq!(\n replace_path_placeholder(&p, \"https://example.com/:foo?:foo\"),\n \"https://example.com/xxx?:foo\",\n );\n }\n\n #[test]\n fn placeholder_missing() {\n let p = HttpUrlParameter {\n enabled: true,\n name: \"\".to_string(),\n value: \"\".to_string(),\n id: None,\n };\n assert_eq!(\n replace_path_placeholder(&p, \"https://example.com/:missing\"),\n \"https://example.com/:missing\",\n );\n }\n\n #[test]\n fn placeholder_disabled() {\n let p = HttpUrlParameter {\n enabled: false,\n name: \":foo\".to_string(),\n value: \"xxx\".to_string(),\n id: None,\n };\n assert_eq!(\n replace_path_placeholder(&p, \"https://example.com/:foo\"),\n \"https://example.com/:foo\",\n );\n }\n\n #[test]\n fn placeholder_prefix() {\n let p =\n HttpUrlParameter { name: \":foo\".into(), value: \"xxx\".into(), enabled: true, id: None };\n assert_eq!(\n replace_path_placeholder(&p, \"https://example.com/:foooo\"),\n \"https://example.com/:foooo\",\n );\n }\n\n #[test]\n fn placeholder_encode() {\n let p = HttpUrlParameter {\n name: \":foo\".into(),\n value: \"Hello World\".into(),\n enabled: true,\n id: None,\n };\n assert_eq!(\n replace_path_placeholder(&p, \"https://example.com/:foo\"),\n \"https://example.com/Hello%20World\",\n );\n }\n\n #[test]\n fn apply_placeholder() {\n let req = HttpRequest {\n url: \"example.com/:a/bar\".to_string(),\n url_parameters: vec![\n HttpUrlParameter {\n name: \"b\".to_string(),\n value: \"bbb\".to_string(),\n enabled: true,\n id: None,\n },\n HttpUrlParameter {\n name: \":a\".to_string(),\n value: \"aaa\".to_string(),\n enabled: true,\n id: None,\n },\n ],\n ..Default::default()\n };\n\n let (url, url_parameters) = apply_path_placeholders(&req.url, &req.url_parameters);\n\n // Pattern match back to access it\n assert_eq!(url, \"example.com/aaa/bar\");\n assert_eq!(url_parameters.len(), 1);\n assert_eq!(url_parameters[0].name, \"b\");\n assert_eq!(url_parameters[0].value, \"bbb\");\n }\n}\n" }, { "path": "crates/yaak-http/src/proto.rs", "content": "use reqwest::Url;\nuse std::str::FromStr;\n\npub(crate) fn ensure_proto(url_str: &str) -> String {\n if url_str.is_empty() {\n return \"\".to_string();\n }\n\n if url_str.starts_with(\"http://\") || url_str.starts_with(\"https://\") {\n return url_str.to_string();\n }\n\n // Url::from_str will fail without a proto, so add one\n let parseable_url = format!(\"http://{}\", url_str);\n if let Ok(u) = Url::from_str(parseable_url.as_str()) {\n match u.host() {\n Some(host) => {\n let h = host.to_string();\n // These TLDs force HTTPS\n if h.ends_with(\".app\") || h.ends_with(\".dev\") || h.ends_with(\".page\") {\n return format!(\"https://{url_str}\");\n }\n }\n None => {}\n }\n }\n\n format!(\"http://{url_str}\")\n}\n" }, { "path": "crates/yaak-http/src/sender.rs", "content": "use crate::decompress::{ContentEncoding, streaming_decoder};\nuse crate::error::{Error, Result};\nuse crate::types::{SendableBody, SendableHttpRequest};\nuse async_trait::async_trait;\nuse bytes::Bytes;\nuse futures_util::StreamExt;\nuse http_body::{Body as HttpBody, Frame, SizeHint};\nuse reqwest::{Client, Method, Version};\nuse std::fmt::Display;\nuse std::pin::Pin;\nuse std::task::{Context, Poll};\nuse std::time::Duration;\nuse tokio::io::{AsyncRead, AsyncReadExt, BufReader, ReadBuf};\nuse tokio::sync::mpsc;\nuse tokio_util::io::StreamReader;\n\n#[derive(Debug, Clone)]\npub enum RedirectBehavior {\n /// 307/308: Method and body are preserved\n Preserve,\n /// 303 or 301/302 with POST: Method changed to GET, body dropped\n DropBody,\n}\n\n#[derive(Debug, Clone)]\npub enum HttpResponseEvent {\n Setting(String, String),\n Info(String),\n Redirect {\n url: String,\n status: u16,\n behavior: RedirectBehavior,\n dropped_body: bool,\n dropped_headers: Vec,\n },\n SendUrl {\n method: String,\n scheme: String,\n username: String,\n password: String,\n host: String,\n port: u16,\n path: String,\n query: String,\n fragment: String,\n },\n ReceiveUrl {\n version: Version,\n status: String,\n },\n HeaderUp(String, String),\n HeaderDown(String, String),\n ChunkSent {\n bytes: usize,\n },\n ChunkReceived {\n bytes: usize,\n },\n DnsResolved {\n hostname: String,\n addresses: Vec,\n duration: u64,\n overridden: bool,\n },\n}\n\nimpl Display for HttpResponseEvent {\n fn fmt(&self, f: &mut std::fmt::Formatter<'_>) -> std::fmt::Result {\n match self {\n HttpResponseEvent::Setting(name, value) => write!(f, \"* Setting {}={}\", name, value),\n HttpResponseEvent::Info(s) => write!(f, \"* {}\", s),\n HttpResponseEvent::Redirect {\n url,\n status,\n behavior,\n dropped_body,\n dropped_headers,\n } => {\n let behavior_str = match behavior {\n RedirectBehavior::Preserve => \"preserve\",\n RedirectBehavior::DropBody => \"drop body\",\n };\n let body_str = if *dropped_body { \", body dropped\" } else { \"\" };\n let headers_str = if dropped_headers.is_empty() {\n String::new()\n } else {\n format!(\", headers dropped: {}\", dropped_headers.join(\", \"))\n };\n write!(\n f,\n \"* Redirect {} -> {} ({}{}{})\",\n status, url, behavior_str, body_str, headers_str\n )\n }\n HttpResponseEvent::SendUrl {\n method,\n scheme,\n username,\n password,\n host,\n port,\n path,\n query,\n fragment,\n } => {\n let auth_str = if username.is_empty() && password.is_empty() {\n String::new()\n } else {\n format!(\"{}:{}@\", username, password)\n };\n let query_str =\n if query.is_empty() { String::new() } else { format!(\"?{}\", query) };\n let fragment_str =\n if fragment.is_empty() { String::new() } else { format!(\"#{}\", fragment) };\n write!(\n f,\n \"> {} {}://{}{}:{}{}{}{}\",\n method, scheme, auth_str, host, port, path, query_str, fragment_str\n )\n }\n HttpResponseEvent::ReceiveUrl { version, status } => {\n write!(f, \"< {} {}\", version_to_str(version), status)\n }\n HttpResponseEvent::HeaderUp(name, value) => write!(f, \"> {}: {}\", name, value),\n HttpResponseEvent::HeaderDown(name, value) => write!(f, \"< {}: {}\", name, value),\n HttpResponseEvent::ChunkSent { bytes } => write!(f, \"> [{} bytes sent]\", bytes),\n HttpResponseEvent::ChunkReceived { bytes } => write!(f, \"< [{} bytes received]\", bytes),\n HttpResponseEvent::DnsResolved { hostname, addresses, duration, overridden } => {\n if *overridden {\n write!(f, \"* DNS override {} -> {}\", hostname, addresses.join(\", \"))\n } else {\n write!(\n f,\n \"* DNS resolved {} to {} ({}ms)\",\n hostname,\n addresses.join(\", \"),\n duration\n )\n }\n }\n }\n }\n}\n\nimpl From for yaak_models::models::HttpResponseEventData {\n fn from(event: HttpResponseEvent) -> Self {\n use yaak_models::models::HttpResponseEventData as D;\n match event {\n HttpResponseEvent::Setting(name, value) => D::Setting { name, value },\n HttpResponseEvent::Info(message) => D::Info { message },\n HttpResponseEvent::Redirect {\n url,\n status,\n behavior,\n dropped_body,\n dropped_headers,\n } => D::Redirect {\n url,\n status,\n behavior: match behavior {\n RedirectBehavior::Preserve => \"preserve\".to_string(),\n RedirectBehavior::DropBody => \"drop_body\".to_string(),\n },\n dropped_body,\n dropped_headers,\n },\n HttpResponseEvent::SendUrl {\n method,\n scheme,\n username,\n password,\n host,\n port,\n path,\n query,\n fragment,\n } => {\n D::SendUrl { method, scheme, username, password, host, port, path, query, fragment }\n }\n HttpResponseEvent::ReceiveUrl { version, status } => {\n D::ReceiveUrl { version: format!(\"{:?}\", version), status }\n }\n HttpResponseEvent::HeaderUp(name, value) => D::HeaderUp { name, value },\n HttpResponseEvent::HeaderDown(name, value) => D::HeaderDown { name, value },\n HttpResponseEvent::ChunkSent { bytes } => D::ChunkSent { bytes },\n HttpResponseEvent::ChunkReceived { bytes } => D::ChunkReceived { bytes },\n HttpResponseEvent::DnsResolved { hostname, addresses, duration, overridden } => {\n D::DnsResolved { hostname, addresses, duration, overridden }\n }\n }\n }\n}\n\n/// Statistics about the body after consumption\n#[derive(Debug, Default, Clone)]\npub struct BodyStats {\n /// Size of the body as received over the wire (before decompression)\n pub size_compressed: u64,\n /// Size of the body after decompression\n pub size_decompressed: u64,\n}\n\n/// An AsyncRead wrapper that sends chunk events as data is read\npub struct TrackingRead {\n inner: R,\n event_tx: mpsc::Sender,\n ended: bool,\n}\n\nimpl TrackingRead {\n pub fn new(inner: R, event_tx: mpsc::Sender) -> Self {\n Self { inner, event_tx, ended: false }\n }\n}\n\nimpl AsyncRead for TrackingRead {\n fn poll_read(\n mut self: Pin<&mut Self>,\n cx: &mut Context<'_>,\n buf: &mut ReadBuf<'_>,\n ) -> Poll> {\n let before = buf.filled().len();\n let result = Pin::new(&mut self.inner).poll_read(cx, buf);\n if let Poll::Ready(Ok(())) = &result {\n let bytes_read = buf.filled().len() - before;\n if bytes_read > 0 {\n // Ignore send errors - receiver may have been dropped or channel is full\n let _ =\n self.event_tx.try_send(HttpResponseEvent::ChunkReceived { bytes: bytes_read });\n } else if !self.ended {\n self.ended = true;\n }\n }\n result\n }\n}\n\n/// Type alias for the body stream\ntype BodyStream = Pin>;\n\n/// HTTP response with deferred body consumption.\n/// Headers are available immediately after send(), body can be consumed in different ways.\n/// Note: Debug is manually implemented since BodyStream doesn't implement Debug.\npub struct HttpResponse {\n /// HTTP status code\n pub status: u16,\n /// HTTP status reason phrase (e.g., \"OK\", \"Not Found\")\n pub status_reason: Option,\n /// Response headers (Vec to support multiple headers with same name, e.g., Set-Cookie)\n pub headers: Vec<(String, String)>,\n /// Request headers (Vec to support multiple headers with same name)\n pub request_headers: Vec<(String, String)>,\n /// Content-Length from headers (may differ from actual body size)\n pub content_length: Option,\n /// Final URL (after redirects)\n pub url: String,\n /// Remote address of the server\n pub remote_addr: Option,\n /// HTTP version (e.g., \"HTTP/1.1\", \"HTTP/2\")\n pub version: Option,\n\n /// The body stream (consumed when calling bytes(), text(), write_to_file(), or drain())\n body_stream: Option,\n /// Content-Encoding for decompression\n encoding: ContentEncoding,\n}\n\nimpl std::fmt::Debug for HttpResponse {\n fn fmt(&self, f: &mut std::fmt::Formatter<'_>) -> std::fmt::Result {\n f.debug_struct(\"HttpResponse\")\n .field(\"status\", &self.status)\n .field(\"status_reason\", &self.status_reason)\n .field(\"headers\", &self.headers)\n .field(\"content_length\", &self.content_length)\n .field(\"url\", &self.url)\n .field(\"remote_addr\", &self.remote_addr)\n .field(\"version\", &self.version)\n .field(\"body_stream\", &\"\")\n .field(\"encoding\", &self.encoding)\n .finish()\n }\n}\n\nimpl HttpResponse {\n /// Create a new HttpResponse with an unconsumed body stream\n #[allow(clippy::too_many_arguments)]\n pub fn new(\n status: u16,\n status_reason: Option,\n headers: Vec<(String, String)>,\n request_headers: Vec<(String, String)>,\n content_length: Option,\n url: String,\n remote_addr: Option,\n version: Option,\n body_stream: BodyStream,\n encoding: ContentEncoding,\n ) -> Self {\n Self {\n status,\n status_reason,\n headers,\n request_headers,\n content_length,\n url,\n remote_addr,\n version,\n body_stream: Some(body_stream),\n encoding,\n }\n }\n\n /// Consume the body and return it as bytes (loads entire body into memory).\n /// Also decompresses the body if Content-Encoding is set.\n pub async fn bytes(mut self) -> Result<(Vec, BodyStats)> {\n let stream = self.body_stream.take().ok_or_else(|| {\n Error::RequestError(\"Response body has already been consumed\".to_string())\n })?;\n\n let buf_reader = BufReader::new(stream);\n let mut decoder = streaming_decoder(buf_reader, self.encoding);\n\n let mut decompressed = Vec::new();\n let mut bytes_read = 0u64;\n\n // Read through the decoder in chunks to track compressed size\n let mut buf = [0u8; 8192];\n loop {\n match decoder.read(&mut buf).await {\n Ok(0) => break,\n Ok(n) => {\n decompressed.extend_from_slice(&buf[..n]);\n bytes_read += n as u64;\n }\n Err(e) => {\n return Err(Error::BodyReadError(e.to_string()));\n }\n }\n }\n\n let stats = BodyStats {\n // For now, we can't easily track compressed size when streaming through decoder\n // Use content_length as an approximation, or decompressed size if identity encoding\n size_compressed: self.content_length.unwrap_or(bytes_read),\n size_decompressed: decompressed.len() as u64,\n };\n\n Ok((decompressed, stats))\n }\n\n /// Consume the body and return it as a UTF-8 string.\n pub async fn text(self) -> Result<(String, BodyStats)> {\n let (bytes, stats) = self.bytes().await?;\n let text = String::from_utf8(bytes)\n .map_err(|e| Error::RequestError(format!(\"Response is not valid UTF-8: {}\", e)))?;\n Ok((text, stats))\n }\n\n /// Take the body stream for manual consumption.\n /// Returns an AsyncRead that decompresses on-the-fly if Content-Encoding is set.\n /// The caller is responsible for reading and processing the stream.\n pub fn into_body_stream(&mut self) -> Result> {\n let stream = self.body_stream.take().ok_or_else(|| {\n Error::RequestError(\"Response body has already been consumed\".to_string())\n })?;\n\n let buf_reader = BufReader::new(stream);\n let decoder = streaming_decoder(buf_reader, self.encoding);\n\n Ok(decoder)\n }\n\n /// Discard the body without reading it (useful for redirects).\n pub async fn drain(mut self) -> Result<()> {\n let stream = self.body_stream.take().ok_or_else(|| {\n Error::RequestError(\"Response body has already been consumed\".to_string())\n })?;\n\n // Just read and discard all bytes\n let mut reader = stream;\n let mut buf = [0u8; 8192];\n loop {\n match reader.read(&mut buf).await {\n Ok(0) => break,\n Ok(_) => continue,\n Err(e) => {\n return Err(Error::RequestError(format!(\n \"Failed to drain response body: {}\",\n e\n )));\n }\n }\n }\n\n Ok(())\n }\n}\n\n/// Trait for sending HTTP requests\n#[async_trait]\npub trait HttpSender: Send + Sync {\n /// Send an HTTP request and return the response with headers.\n /// The body is not consumed until you call bytes(), text(), write_to_file(), or drain().\n /// Events are sent through the provided channel.\n async fn send(\n &self,\n request: SendableHttpRequest,\n event_tx: mpsc::Sender,\n ) -> Result;\n}\n\n/// Reqwest-based implementation of HttpSender\npub struct ReqwestSender {\n client: Client,\n}\n\nimpl ReqwestSender {\n /// Create a new ReqwestSender with a default client\n pub fn new() -> Result {\n let client = Client::builder().build().map_err(Error::Client)?;\n Ok(Self { client })\n }\n\n /// Create a new ReqwestSender with a custom client\n pub fn with_client(client: Client) -> Self {\n Self { client }\n }\n}\n\n#[async_trait]\nimpl HttpSender for ReqwestSender {\n async fn send(\n &self,\n request: SendableHttpRequest,\n event_tx: mpsc::Sender,\n ) -> Result {\n // Helper to send events (ignores errors if receiver is dropped or channel is full)\n let send_event = |event: HttpResponseEvent| {\n let _ = event_tx.try_send(event);\n };\n\n // Parse the HTTP method\n let method = Method::from_bytes(request.method.as_bytes())\n .map_err(|e| Error::RequestError(format!(\"Invalid HTTP method: {}\", e)))?;\n\n // Build the request\n let mut req_builder = self.client.request(method, &request.url);\n\n // Add headers\n for header in request.headers {\n if header.0.is_empty() {\n continue;\n }\n req_builder = req_builder.header(&header.0, &header.1);\n }\n\n // Configure timeout\n if let Some(d) = request.options.timeout\n && !d.is_zero()\n {\n req_builder = req_builder.timeout(d);\n }\n\n // Add body\n match request.body {\n None => {}\n Some(SendableBody::Bytes(bytes)) => {\n req_builder = req_builder.body(bytes);\n }\n Some(SendableBody::Stream { data, content_length }) => {\n // Convert AsyncRead stream to reqwest Body. If content length is\n // known, wrap with a SizedBody so hyper can set Content-Length\n // automatically (for both HTTP/1.1 and HTTP/2).\n let stream = tokio_util::io::ReaderStream::new(data);\n let body = if let Some(len) = content_length {\n reqwest::Body::wrap(SizedBody::new(stream, len))\n } else {\n reqwest::Body::wrap_stream(stream)\n };\n req_builder = req_builder.body(body);\n }\n }\n\n // Send the request\n let sendable_req = req_builder.build()?;\n send_event(HttpResponseEvent::Setting(\n \"timeout\".to_string(),\n if request.options.timeout.unwrap_or_default().is_zero() {\n \"Infinity\".to_string()\n } else {\n format!(\"{:?}\", request.options.timeout)\n },\n ));\n\n send_event(HttpResponseEvent::SendUrl {\n method: sendable_req.method().to_string(),\n scheme: sendable_req.url().scheme().to_string(),\n username: sendable_req.url().username().to_string(),\n password: sendable_req.url().password().unwrap_or_default().to_string(),\n host: sendable_req.url().host_str().unwrap_or_default().to_string(),\n port: sendable_req.url().port_or_known_default().unwrap_or(0),\n path: sendable_req.url().path().to_string(),\n query: sendable_req.url().query().unwrap_or_default().to_string(),\n fragment: sendable_req.url().fragment().unwrap_or_default().to_string(),\n });\n\n let mut request_headers = Vec::new();\n for (name, value) in sendable_req.headers() {\n let v = value.to_str().unwrap_or_default().to_string();\n request_headers.push((name.to_string(), v.clone()));\n send_event(HttpResponseEvent::HeaderUp(name.to_string(), v));\n }\n send_event(HttpResponseEvent::Info(\"Sending request to server\".to_string()));\n\n // Map some errors to our own, so they look nicer\n let response = self.client.execute(sendable_req).await.map_err(|e| {\n if reqwest::Error::is_timeout(&e) {\n Error::RequestTimeout(\n request.options.timeout.unwrap_or(Duration::from_secs(0)).clone(),\n )\n } else {\n Error::Client(e)\n }\n })?;\n\n let status = response.status().as_u16();\n let status_reason = response.status().canonical_reason().map(|s| s.to_string());\n let url = response.url().to_string();\n let remote_addr = response.remote_addr().map(|a| a.to_string());\n let version = Some(version_to_str(&response.version()));\n let content_length = response.content_length();\n\n send_event(HttpResponseEvent::ReceiveUrl {\n version: response.version(),\n status: response.status().to_string(),\n });\n\n // Extract headers (use Vec to preserve duplicates like Set-Cookie)\n let mut headers = Vec::new();\n for (key, value) in response.headers() {\n if let Ok(v) = value.to_str() {\n send_event(HttpResponseEvent::HeaderDown(key.to_string(), v.to_string()));\n headers.push((key.to_string(), v.to_string()));\n }\n }\n\n // Determine content encoding for decompression\n // HTTP headers are case-insensitive, so we need to search for any casing\n let encoding = ContentEncoding::from_header(\n headers\n .iter()\n .find(|(k, _)| k.eq_ignore_ascii_case(\"content-encoding\"))\n .map(|(_, v)| v.as_str()),\n );\n\n // Get the byte stream instead of loading into memory\n let byte_stream = response.bytes_stream();\n\n // Convert the stream to an AsyncRead\n let stream_reader = StreamReader::new(\n byte_stream.map(|result| result.map_err(|e| std::io::Error::other(e))),\n );\n\n // Wrap the stream with tracking to emit chunk received events via the same channel\n let tracking_reader = TrackingRead::new(stream_reader, event_tx);\n let body_stream: BodyStream = Box::pin(tracking_reader);\n\n Ok(HttpResponse::new(\n status,\n status_reason,\n headers,\n request_headers,\n content_length,\n url,\n remote_addr,\n version,\n body_stream,\n encoding,\n ))\n }\n}\n\n/// A wrapper around a byte stream that reports a known content length via\n/// `size_hint()`. This lets hyper set the `Content-Length` header\n/// automatically based on the body size, without us having to add it as an\n/// explicit header β€” which can cause duplicate `Content-Length` headers and\n/// break HTTP/2.\nstruct SizedBody {\n stream: std::sync::Mutex,\n remaining: u64,\n}\n\nimpl SizedBody {\n fn new(stream: S, content_length: u64) -> Self {\n Self { stream: std::sync::Mutex::new(stream), remaining: content_length }\n }\n}\n\nimpl HttpBody for SizedBody\nwhere\n S: futures_util::Stream>\n + Send\n + Unpin\n + 'static,\n{\n type Data = Bytes;\n type Error = std::io::Error;\n\n fn poll_frame(\n self: Pin<&mut Self>,\n cx: &mut Context<'_>,\n ) -> Poll, Self::Error>>> {\n let this = self.get_mut();\n let mut stream = this.stream.lock().unwrap();\n match stream.poll_next_unpin(cx) {\n Poll::Ready(Some(Ok(chunk))) => {\n this.remaining = this.remaining.saturating_sub(chunk.len() as u64);\n Poll::Ready(Some(Ok(Frame::data(chunk))))\n }\n Poll::Ready(Some(Err(e))) => Poll::Ready(Some(Err(e))),\n Poll::Ready(None) => Poll::Ready(None),\n Poll::Pending => Poll::Pending,\n }\n }\n\n fn size_hint(&self) -> SizeHint {\n SizeHint::with_exact(self.remaining)\n }\n}\n\nfn version_to_str(version: &Version) -> String {\n match *version {\n Version::HTTP_09 => \"HTTP/0.9\".to_string(),\n Version::HTTP_10 => \"HTTP/1.0\".to_string(),\n Version::HTTP_11 => \"HTTP/1.1\".to_string(),\n Version::HTTP_2 => \"HTTP/2\".to_string(),\n Version::HTTP_3 => \"HTTP/3\".to_string(),\n _ => \"unknown\".to_string(),\n }\n}\n" }, { "path": "crates/yaak-http/src/tee_reader.rs", "content": "use std::io;\nuse std::pin::Pin;\nuse std::task::{Context, Poll};\nuse tokio::io::{AsyncRead, ReadBuf};\nuse tokio::sync::mpsc;\n\n/// A reader that forwards all read data to a channel while also returning it to the caller.\n/// This allows capturing request body data as it's being sent.\n/// Uses an unbounded channel to ensure all data is captured without blocking the request.\npub struct TeeReader {\n inner: R,\n tx: mpsc::UnboundedSender>,\n}\n\nimpl TeeReader {\n pub fn new(inner: R, tx: mpsc::UnboundedSender>) -> Self {\n Self { inner, tx }\n }\n}\n\nimpl AsyncRead for TeeReader {\n fn poll_read(\n mut self: Pin<&mut Self>,\n cx: &mut Context<'_>,\n buf: &mut ReadBuf<'_>,\n ) -> Poll> {\n let before_len = buf.filled().len();\n\n match Pin::new(&mut self.inner).poll_read(cx, buf) {\n Poll::Ready(Ok(())) => {\n let after_len = buf.filled().len();\n if after_len > before_len {\n // Data was read, send a copy to the channel\n let data = buf.filled()[before_len..after_len].to_vec();\n // Send to unbounded channel - this never blocks\n // Ignore error if receiver is closed\n let _ = self.tx.send(data);\n }\n Poll::Ready(Ok(()))\n }\n Poll::Ready(Err(e)) => Poll::Ready(Err(e)),\n Poll::Pending => Poll::Pending,\n }\n }\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n use std::io::Cursor;\n use tokio::io::AsyncReadExt;\n\n #[tokio::test]\n async fn test_tee_reader_captures_all_data() {\n let data = b\"Hello, World!\";\n let cursor = Cursor::new(data.to_vec());\n let (tx, mut rx) = mpsc::unbounded_channel();\n\n let mut tee = TeeReader::new(cursor, tx);\n let mut output = Vec::new();\n tee.read_to_end(&mut output).await.unwrap();\n\n // Verify the reader returns the correct data\n assert_eq!(output, data);\n\n // Verify the channel received the data\n let mut captured = Vec::new();\n while let Ok(chunk) = rx.try_recv() {\n captured.extend(chunk);\n }\n assert_eq!(captured, data);\n }\n\n #[tokio::test]\n async fn test_tee_reader_with_chunked_reads() {\n let data = b\"ABCDEFGHIJKLMNOPQRSTUVWXYZ\";\n let cursor = Cursor::new(data.to_vec());\n let (tx, mut rx) = mpsc::unbounded_channel();\n\n let mut tee = TeeReader::new(cursor, tx);\n\n // Read in small chunks\n let mut buf = [0u8; 5];\n let mut output = Vec::new();\n loop {\n let n = tee.read(&mut buf).await.unwrap();\n if n == 0 {\n break;\n }\n output.extend_from_slice(&buf[..n]);\n }\n\n // Verify the reader returns the correct data\n assert_eq!(output, data);\n\n // Verify the channel received all chunks\n let mut captured = Vec::new();\n while let Ok(chunk) = rx.try_recv() {\n captured.extend(chunk);\n }\n assert_eq!(captured, data);\n }\n\n #[tokio::test]\n async fn test_tee_reader_empty_data() {\n let data: Vec = vec![];\n let cursor = Cursor::new(data.clone());\n let (tx, mut rx) = mpsc::unbounded_channel();\n\n let mut tee = TeeReader::new(cursor, tx);\n let mut output = Vec::new();\n tee.read_to_end(&mut output).await.unwrap();\n\n // Verify empty output\n assert!(output.is_empty());\n\n // Verify no data was sent to channel\n assert!(rx.try_recv().is_err());\n }\n\n #[tokio::test]\n async fn test_tee_reader_works_when_receiver_dropped() {\n let data = b\"Hello, World!\";\n let cursor = Cursor::new(data.to_vec());\n let (tx, rx) = mpsc::unbounded_channel();\n\n // Drop the receiver before reading\n drop(rx);\n\n let mut tee = TeeReader::new(cursor, tx);\n let mut output = Vec::new();\n\n // Should still work even though receiver is dropped\n tee.read_to_end(&mut output).await.unwrap();\n assert_eq!(output, data);\n }\n\n #[tokio::test]\n async fn test_tee_reader_large_data() {\n // Test with 1MB of data\n let data: Vec = (0..1024 * 1024).map(|i| (i % 256) as u8).collect();\n let cursor = Cursor::new(data.clone());\n let (tx, mut rx) = mpsc::unbounded_channel();\n\n let mut tee = TeeReader::new(cursor, tx);\n let mut output = Vec::new();\n tee.read_to_end(&mut output).await.unwrap();\n\n // Verify the reader returns the correct data\n assert_eq!(output, data);\n\n // Verify the channel received all data\n let mut captured = Vec::new();\n while let Ok(chunk) = rx.try_recv() {\n captured.extend(chunk);\n }\n assert_eq!(captured, data);\n }\n}\n" }, { "path": "crates/yaak-http/src/transaction.rs", "content": "use crate::cookies::CookieStore;\nuse crate::error::Result;\nuse crate::sender::{HttpResponse, HttpResponseEvent, HttpSender, RedirectBehavior};\nuse crate::types::{SendableBody, SendableHttpRequest};\nuse log::debug;\nuse tokio::sync::mpsc;\nuse tokio::sync::watch::Receiver;\nuse url::Url;\n\n/// HTTP Transaction that manages the lifecycle of a request, including redirect handling\npub struct HttpTransaction {\n sender: S,\n max_redirects: usize,\n cookie_store: Option,\n}\n\nimpl HttpTransaction {\n /// Create a new transaction with default settings\n pub fn new(sender: S) -> Self {\n Self { sender, max_redirects: 10, cookie_store: None }\n }\n\n /// Create a new transaction with custom max redirects\n pub fn with_max_redirects(sender: S, max_redirects: usize) -> Self {\n Self { sender, max_redirects, cookie_store: None }\n }\n\n /// Create a new transaction with a cookie store\n pub fn with_cookie_store(sender: S, cookie_store: CookieStore) -> Self {\n Self { sender, max_redirects: 10, cookie_store: Some(cookie_store) }\n }\n\n /// Create a new transaction with custom max redirects and a cookie store\n pub fn with_options(\n sender: S,\n max_redirects: usize,\n cookie_store: Option,\n ) -> Self {\n Self { sender, max_redirects, cookie_store }\n }\n\n /// Execute the request with cancellation support.\n /// Returns an HttpResponse with unconsumed body - caller decides how to consume it.\n /// Events are sent through the provided channel.\n pub async fn execute_with_cancellation(\n &self,\n request: SendableHttpRequest,\n mut cancelled_rx: Receiver,\n event_tx: mpsc::Sender,\n ) -> Result {\n let mut redirect_count = 0;\n let mut current_url = request.url;\n let mut current_method = request.method;\n let mut current_headers = request.headers;\n let mut current_body = request.body;\n\n // Helper to send events (ignores errors if receiver is dropped or channel is full)\n let send_event = |event: HttpResponseEvent| {\n let _ = event_tx.try_send(event);\n };\n\n loop {\n // Check for cancellation before each request\n if *cancelled_rx.borrow() {\n return Err(crate::error::Error::RequestCanceledError);\n }\n\n // Inject cookies into headers if we have a cookie store\n let headers_with_cookies = if let Some(cookie_store) = &self.cookie_store {\n let mut headers = current_headers.clone();\n if let Ok(url) = Url::parse(¤t_url) {\n if let Some(cookie_header) = cookie_store.get_cookie_header(&url) {\n debug!(\"Injecting Cookie header: {}\", cookie_header);\n // Check if there's already a Cookie header and merge if so\n if let Some(existing) =\n headers.iter_mut().find(|h| h.0.eq_ignore_ascii_case(\"cookie\"))\n {\n existing.1 = format!(\"{}; {}\", existing.1, cookie_header);\n } else {\n headers.push((\"Cookie\".to_string(), cookie_header));\n }\n }\n }\n headers\n } else {\n current_headers.clone()\n };\n\n // Build request for this iteration\n let preserved_body = match ¤t_body {\n Some(SendableBody::Bytes(b)) => Some(SendableBody::Bytes(b.clone())),\n _ => None,\n };\n let request_had_body = current_body.is_some();\n let req = SendableHttpRequest {\n url: current_url.clone(),\n method: current_method.clone(),\n headers: headers_with_cookies,\n body: current_body,\n options: request.options.clone(),\n };\n\n // Send the request\n send_event(HttpResponseEvent::Setting(\n \"redirects\".to_string(),\n request.options.follow_redirects.to_string(),\n ));\n\n // Execute with cancellation support\n let response = tokio::select! {\n result = self.sender.send(req, event_tx.clone()) => result?,\n _ = cancelled_rx.changed() => {\n return Err(crate::error::Error::RequestCanceledError);\n }\n };\n\n // Parse Set-Cookie headers and store cookies\n if let Some(cookie_store) = &self.cookie_store {\n if let Ok(url) = Url::parse(¤t_url) {\n let set_cookie_headers: Vec = response\n .headers\n .iter()\n .filter(|(k, _)| k.eq_ignore_ascii_case(\"set-cookie\"))\n .map(|(_, v)| v.clone())\n .collect();\n\n if !set_cookie_headers.is_empty() {\n debug!(\"Storing {} cookies from response\", set_cookie_headers.len());\n cookie_store.store_cookies_from_response(&url, &set_cookie_headers);\n }\n }\n }\n\n if !Self::is_redirect(response.status) {\n // Not a redirect - return the response for caller to consume body\n return Ok(response);\n }\n\n if !request.options.follow_redirects {\n // Redirects disabled - return the redirect response as-is\n return Ok(response);\n }\n\n // Check if we've exceeded max redirects\n if redirect_count >= self.max_redirects {\n // Drain the response before returning error\n let _ = response.drain().await;\n return Err(crate::error::Error::RequestError(format!(\n \"Maximum redirect limit ({}) exceeded\",\n self.max_redirects\n )));\n }\n\n // Extract Location header before draining (headers are available immediately)\n // HTTP headers are case-insensitive, so we need to search for any casing\n let location = response\n .headers\n .iter()\n .find(|(k, _)| k.eq_ignore_ascii_case(\"location\"))\n .map(|(_, v)| v.clone())\n .ok_or_else(|| {\n crate::error::Error::RequestError(\n \"Redirect response missing Location header\".to_string(),\n )\n })?;\n\n // Also get status before draining\n let status = response.status;\n\n send_event(HttpResponseEvent::Info(\"Ignoring the response body\".to_string()));\n\n // Drain the redirect response body before following\n response.drain().await?;\n\n // Update the request URL\n let previous_url = current_url.clone();\n current_url = if location.starts_with(\"http://\") || location.starts_with(\"https://\") {\n // Absolute URL\n location\n } else if location.starts_with('/') {\n // Absolute path - need to extract base URL from current request\n let base_url = Self::extract_base_url(¤t_url)?;\n format!(\"{}{}\", base_url, location)\n } else {\n // Relative path - need to resolve relative to current path\n let base_path = Self::extract_base_path(¤t_url)?;\n format!(\"{}/{}\", base_path, location)\n };\n\n // Determine redirect behavior based on status code and method\n let behavior = if status == 303 {\n // 303 See Other always changes to GET\n RedirectBehavior::DropBody\n } else if (status == 301 || status == 302) && current_method == \"POST\" {\n // For 301/302, change POST to GET (common browser behavior)\n RedirectBehavior::DropBody\n } else {\n // For 307 and 308, the method and body are preserved\n // Also for 301/302 with non-POST methods\n RedirectBehavior::Preserve\n };\n\n let mut dropped_headers =\n Self::remove_sensitive_headers(&mut current_headers, &previous_url, ¤t_url);\n\n // Handle method changes for certain redirect codes\n if matches!(behavior, RedirectBehavior::DropBody) {\n if current_method != \"GET\" {\n current_method = \"GET\".to_string();\n }\n // Remove content-related headers\n current_headers.retain(|h| {\n let name_lower = h.0.to_lowercase();\n let should_drop =\n name_lower.starts_with(\"content-\") || name_lower == \"transfer-encoding\";\n if should_drop {\n Self::push_header_if_missing(&mut dropped_headers, &h.0);\n }\n !should_drop\n });\n }\n\n // Restore body for Preserve redirects (307/308), drop for others.\n // Stream bodies can't be replayed (same limitation as reqwest).\n current_body = if matches!(behavior, RedirectBehavior::Preserve) {\n if request_had_body && preserved_body.is_none() {\n // Stream body was consumed and can't be replayed (same as reqwest)\n return Err(crate::error::Error::RequestError(\n \"Cannot follow redirect: request body was a stream and cannot be resent\"\n .to_string(),\n ));\n }\n preserved_body\n } else {\n None\n };\n\n // Body was dropped if the request had one but we can't resend it\n let dropped_body = request_had_body && current_body.is_none();\n\n send_event(HttpResponseEvent::Redirect {\n url: current_url.clone(),\n status,\n behavior: behavior.clone(),\n dropped_body,\n dropped_headers,\n });\n\n redirect_count += 1;\n }\n }\n\n /// Remove sensitive headers when redirecting to a different host.\n /// This matches reqwest's `remove_sensitive_headers()` behavior and prevents\n /// credentials from being forwarded to third-party servers (e.g., an\n /// Authorization header sent from an API redirect to an S3 bucket).\n fn remove_sensitive_headers(\n headers: &mut Vec<(String, String)>,\n previous_url: &str,\n next_url: &str,\n ) -> Vec {\n let mut dropped_headers = Vec::new();\n let previous_host = Url::parse(previous_url).ok().and_then(|u| {\n u.host_str().map(|h| format!(\"{}:{}\", h, u.port_or_known_default().unwrap_or(0)))\n });\n let next_host = Url::parse(next_url).ok().and_then(|u| {\n u.host_str().map(|h| format!(\"{}:{}\", h, u.port_or_known_default().unwrap_or(0)))\n });\n if previous_host != next_host {\n headers.retain(|h| {\n let name_lower = h.0.to_lowercase();\n let should_drop = name_lower == \"authorization\"\n || name_lower == \"cookie\"\n || name_lower == \"cookie2\"\n || name_lower == \"proxy-authorization\"\n || name_lower == \"www-authenticate\";\n if should_drop {\n Self::push_header_if_missing(&mut dropped_headers, &h.0);\n }\n !should_drop\n });\n }\n dropped_headers\n }\n\n fn push_header_if_missing(headers: &mut Vec, name: &str) {\n if !headers.iter().any(|h| h.eq_ignore_ascii_case(name)) {\n headers.push(name.to_string());\n }\n }\n\n /// Check if a status code indicates a redirect\n fn is_redirect(status: u16) -> bool {\n matches!(status, 301 | 302 | 303 | 307 | 308)\n }\n\n /// Extract the base URL (scheme + host) from a full URL\n fn extract_base_url(url: &str) -> Result {\n // Find the position after \"://\"\n let scheme_end = url.find(\"://\").ok_or_else(|| {\n crate::error::Error::RequestError(format!(\"Invalid URL format: {}\", url))\n })?;\n\n // Find the first '/' after the scheme\n let path_start = url[scheme_end + 3..].find('/');\n\n if let Some(idx) = path_start {\n Ok(url[..scheme_end + 3 + idx].to_string())\n } else {\n // No path, return entire URL\n Ok(url.to_string())\n }\n }\n\n /// Extract the base path (everything except the last segment) from a URL\n fn extract_base_path(url: &str) -> Result {\n if let Some(last_slash) = url.rfind('/') {\n // Don't include the trailing slash if it's part of the host\n if url[..last_slash].ends_with(\"://\") || url[..last_slash].ends_with(':') {\n Ok(url.to_string())\n } else {\n Ok(url[..last_slash].to_string())\n }\n } else {\n Ok(url.to_string())\n }\n }\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n use crate::decompress::ContentEncoding;\n use crate::sender::{HttpResponseEvent, HttpSender};\n use async_trait::async_trait;\n use std::pin::Pin;\n use std::sync::Arc;\n use tokio::io::AsyncRead;\n use tokio::sync::Mutex;\n\n /// Captured request metadata for test assertions\n #[derive(Debug, Clone)]\n #[allow(dead_code)]\n struct CapturedRequest {\n url: String,\n method: String,\n headers: Vec<(String, String)>,\n }\n\n /// Mock sender for testing\n struct MockSender {\n responses: Arc>>,\n /// Captured requests for assertions\n captured_requests: Arc>>,\n }\n\n struct MockResponse {\n status: u16,\n headers: Vec<(String, String)>,\n body: Vec,\n }\n\n impl MockSender {\n fn new(responses: Vec) -> Self {\n Self {\n responses: Arc::new(Mutex::new(responses)),\n captured_requests: Arc::new(Mutex::new(Vec::new())),\n }\n }\n }\n\n #[async_trait]\n impl HttpSender for MockSender {\n async fn send(\n &self,\n request: SendableHttpRequest,\n _event_tx: mpsc::Sender,\n ) -> Result {\n // Capture the request metadata for later assertions\n self.captured_requests.lock().await.push(CapturedRequest {\n url: request.url.clone(),\n method: request.method.clone(),\n headers: request.headers.clone(),\n });\n\n let mut responses = self.responses.lock().await;\n if responses.is_empty() {\n Err(crate::error::Error::RequestError(\"No more mock responses\".to_string()))\n } else {\n let mock = responses.remove(0);\n // Create a simple in-memory stream from the body\n let body_stream: Pin> =\n Box::pin(std::io::Cursor::new(mock.body));\n Ok(HttpResponse::new(\n mock.status,\n None, // status_reason\n mock.headers,\n Vec::new(),\n None, // content_length\n \"https://example.com\".to_string(), // url\n None, // remote_addr\n Some(\"HTTP/1.1\".to_string()), // version\n body_stream,\n ContentEncoding::Identity,\n ))\n }\n }\n }\n\n #[tokio::test]\n async fn test_transaction_no_redirect() {\n let response = MockResponse { status: 200, headers: Vec::new(), body: b\"OK\".to_vec() };\n let sender = MockSender::new(vec![response]);\n let transaction = HttpTransaction::new(sender);\n\n let request = SendableHttpRequest {\n url: \"https://example.com\".to_string(),\n method: \"GET\".to_string(),\n headers: vec![],\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await.unwrap();\n assert_eq!(result.status, 200);\n\n // Consume the body to verify it\n let (body, _) = result.bytes().await.unwrap();\n assert_eq!(body, b\"OK\");\n }\n\n #[tokio::test]\n async fn test_transaction_single_redirect() {\n let redirect_headers =\n vec![(\"Location\".to_string(), \"https://example.com/new\".to_string())];\n\n let responses = vec![\n MockResponse { status: 302, headers: redirect_headers, body: vec![] },\n MockResponse { status: 200, headers: Vec::new(), body: b\"Final\".to_vec() },\n ];\n\n let sender = MockSender::new(responses);\n let transaction = HttpTransaction::new(sender);\n\n let request = SendableHttpRequest {\n url: \"https://example.com/old\".to_string(),\n method: \"GET\".to_string(),\n options: crate::types::SendableHttpRequestOptions {\n follow_redirects: true,\n ..Default::default()\n },\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await.unwrap();\n assert_eq!(result.status, 200);\n\n let (body, _) = result.bytes().await.unwrap();\n assert_eq!(body, b\"Final\");\n }\n\n #[tokio::test]\n async fn test_transaction_max_redirects_exceeded() {\n let redirect_headers =\n vec![(\"Location\".to_string(), \"https://example.com/loop\".to_string())];\n\n // Create more redirects than allowed\n let responses: Vec = (0..12)\n .map(|_| MockResponse { status: 302, headers: redirect_headers.clone(), body: vec![] })\n .collect();\n\n let sender = MockSender::new(responses);\n let transaction = HttpTransaction::with_max_redirects(sender, 10);\n\n let request = SendableHttpRequest {\n url: \"https://example.com/start\".to_string(),\n method: \"GET\".to_string(),\n options: crate::types::SendableHttpRequestOptions {\n follow_redirects: true,\n ..Default::default()\n },\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await;\n if let Err(crate::error::Error::RequestError(msg)) = result {\n assert!(msg.contains(\"Maximum redirect limit\"));\n } else {\n panic!(\"Expected RequestError with max redirect message. Got {result:?}\");\n }\n }\n\n #[test]\n fn test_is_redirect() {\n assert!(HttpTransaction::::is_redirect(301));\n assert!(HttpTransaction::::is_redirect(302));\n assert!(HttpTransaction::::is_redirect(303));\n assert!(HttpTransaction::::is_redirect(307));\n assert!(HttpTransaction::::is_redirect(308));\n assert!(!HttpTransaction::::is_redirect(200));\n assert!(!HttpTransaction::::is_redirect(404));\n assert!(!HttpTransaction::::is_redirect(500));\n }\n\n #[test]\n fn test_extract_base_url() {\n let result =\n HttpTransaction::::extract_base_url(\"https://example.com/path/to/resource\");\n assert_eq!(result.unwrap(), \"https://example.com\");\n\n let result = HttpTransaction::::extract_base_url(\"http://localhost:8080/api\");\n assert_eq!(result.unwrap(), \"http://localhost:8080\");\n\n let result = HttpTransaction::::extract_base_url(\"invalid-url\");\n assert!(result.is_err());\n }\n\n #[test]\n fn test_extract_base_path() {\n let result = HttpTransaction::::extract_base_path(\n \"https://example.com/path/to/resource\",\n );\n assert_eq!(result.unwrap(), \"https://example.com/path/to\");\n\n let result = HttpTransaction::::extract_base_path(\"https://example.com/single\");\n assert_eq!(result.unwrap(), \"https://example.com\");\n\n let result = HttpTransaction::::extract_base_path(\"https://example.com/\");\n assert_eq!(result.unwrap(), \"https://example.com\");\n }\n\n #[tokio::test]\n async fn test_cookie_injection() {\n // Create a mock sender that verifies the Cookie header was injected\n struct CookieVerifyingSender {\n expected_cookie: String,\n }\n\n #[async_trait]\n impl HttpSender for CookieVerifyingSender {\n async fn send(\n &self,\n request: SendableHttpRequest,\n _event_tx: mpsc::Sender,\n ) -> Result {\n // Verify the Cookie header was injected\n let cookie_header =\n request.headers.iter().find(|(k, _)| k.eq_ignore_ascii_case(\"cookie\"));\n\n assert!(cookie_header.is_some(), \"Cookie header should be present\");\n assert!(\n cookie_header.unwrap().1.contains(&self.expected_cookie),\n \"Cookie header should contain expected value\"\n );\n\n let body_stream: Pin> =\n Box::pin(std::io::Cursor::new(vec![]));\n Ok(HttpResponse::new(\n 200,\n None,\n Vec::new(),\n Vec::new(),\n None,\n \"https://example.com\".to_string(),\n None,\n Some(\"HTTP/1.1\".to_string()),\n body_stream,\n ContentEncoding::Identity,\n ))\n }\n }\n\n use yaak_models::models::{Cookie, CookieDomain, CookieExpires};\n\n // Create a cookie store with a test cookie\n let cookie = Cookie {\n raw_cookie: \"session=abc123\".to_string(),\n domain: CookieDomain::HostOnly(\"example.com\".to_string()),\n expires: CookieExpires::SessionEnd,\n path: (\"/\".to_string(), false),\n };\n let cookie_store = CookieStore::from_cookies(vec![cookie]);\n\n let sender = CookieVerifyingSender { expected_cookie: \"session=abc123\".to_string() };\n let transaction = HttpTransaction::with_cookie_store(sender, cookie_store);\n\n let request = SendableHttpRequest {\n url: \"https://example.com/api\".to_string(),\n method: \"GET\".to_string(),\n headers: vec![],\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await;\n assert!(result.is_ok());\n }\n\n #[tokio::test]\n async fn test_set_cookie_parsing() {\n // Create a cookie store\n let cookie_store = CookieStore::new();\n\n // Mock sender that returns a Set-Cookie header\n struct SetCookieSender;\n\n #[async_trait]\n impl HttpSender for SetCookieSender {\n async fn send(\n &self,\n _request: SendableHttpRequest,\n _event_tx: mpsc::Sender,\n ) -> Result {\n let headers =\n vec![(\"set-cookie\".to_string(), \"session=xyz789; Path=/\".to_string())];\n\n let body_stream: Pin> =\n Box::pin(std::io::Cursor::new(vec![]));\n Ok(HttpResponse::new(\n 200,\n None,\n headers,\n Vec::new(),\n None,\n \"https://example.com\".to_string(),\n None,\n Some(\"HTTP/1.1\".to_string()),\n body_stream,\n ContentEncoding::Identity,\n ))\n }\n }\n\n let sender = SetCookieSender;\n let transaction = HttpTransaction::with_cookie_store(sender, cookie_store.clone());\n\n let request = SendableHttpRequest {\n url: \"https://example.com/login\".to_string(),\n method: \"POST\".to_string(),\n headers: vec![],\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await;\n assert!(result.is_ok());\n\n // Verify the cookie was stored\n let cookies = cookie_store.get_all_cookies();\n assert_eq!(cookies.len(), 1);\n assert!(cookies[0].raw_cookie.contains(\"session=xyz789\"));\n }\n\n #[tokio::test]\n async fn test_multiple_set_cookie_headers() {\n // Create a cookie store\n let cookie_store = CookieStore::new();\n\n // Mock sender that returns multiple Set-Cookie headers\n struct MultiSetCookieSender;\n\n #[async_trait]\n impl HttpSender for MultiSetCookieSender {\n async fn send(\n &self,\n _request: SendableHttpRequest,\n _event_tx: mpsc::Sender,\n ) -> Result {\n // Multiple Set-Cookie headers (this is standard HTTP behavior)\n let headers = vec![\n (\"set-cookie\".to_string(), \"session=abc123; Path=/\".to_string()),\n (\"set-cookie\".to_string(), \"user_id=42; Path=/\".to_string()),\n (\n \"set-cookie\".to_string(),\n \"preferences=dark; Path=/; Max-Age=86400\".to_string(),\n ),\n ];\n\n let body_stream: Pin> =\n Box::pin(std::io::Cursor::new(vec![]));\n Ok(HttpResponse::new(\n 200,\n None,\n headers,\n Vec::new(),\n None,\n \"https://example.com\".to_string(),\n None,\n Some(\"HTTP/1.1\".to_string()),\n body_stream,\n ContentEncoding::Identity,\n ))\n }\n }\n\n let sender = MultiSetCookieSender;\n let transaction = HttpTransaction::with_cookie_store(sender, cookie_store.clone());\n\n let request = SendableHttpRequest {\n url: \"https://example.com/login\".to_string(),\n method: \"POST\".to_string(),\n headers: vec![],\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await;\n assert!(result.is_ok());\n\n // Verify all three cookies were stored\n let cookies = cookie_store.get_all_cookies();\n assert_eq!(cookies.len(), 3, \"All three Set-Cookie headers should be parsed and stored\");\n\n let cookie_values: Vec<&str> = cookies.iter().map(|c| c.raw_cookie.as_str()).collect();\n assert!(\n cookie_values.iter().any(|c| c.contains(\"session=abc123\")),\n \"session cookie should be stored\"\n );\n assert!(\n cookie_values.iter().any(|c| c.contains(\"user_id=42\")),\n \"user_id cookie should be stored\"\n );\n assert!(\n cookie_values.iter().any(|c| c.contains(\"preferences=dark\")),\n \"preferences cookie should be stored\"\n );\n }\n\n #[tokio::test]\n async fn test_cookies_across_redirects() {\n use std::sync::atomic::{AtomicUsize, Ordering};\n\n // Create a cookie store\n let cookie_store = CookieStore::new();\n\n // Track request count\n let request_count = Arc::new(AtomicUsize::new(0));\n let request_count_clone = request_count.clone();\n\n struct RedirectWithCookiesSender {\n request_count: Arc,\n }\n\n #[async_trait]\n impl HttpSender for RedirectWithCookiesSender {\n async fn send(\n &self,\n request: SendableHttpRequest,\n _event_tx: mpsc::Sender,\n ) -> Result {\n let count = self.request_count.fetch_add(1, Ordering::SeqCst);\n\n let (status, headers) = if count == 0 {\n // First request: return redirect with Set-Cookie\n let h = vec![\n (\"location\".to_string(), \"https://example.com/final\".to_string()),\n (\"set-cookie\".to_string(), \"redirect_cookie=value1\".to_string()),\n ];\n (302, h)\n } else {\n // Second request: verify cookie was sent\n let cookie_header =\n request.headers.iter().find(|(k, _)| k.eq_ignore_ascii_case(\"cookie\"));\n\n assert!(cookie_header.is_some(), \"Cookie header should be present on redirect\");\n assert!(\n cookie_header.unwrap().1.contains(\"redirect_cookie=value1\"),\n \"Redirect cookie should be included\"\n );\n\n (200, Vec::new())\n };\n\n let body_stream: Pin> =\n Box::pin(std::io::Cursor::new(vec![]));\n Ok(HttpResponse::new(\n status,\n None,\n headers,\n Vec::new(),\n None,\n \"https://example.com\".to_string(),\n None,\n Some(\"HTTP/1.1\".to_string()),\n body_stream,\n ContentEncoding::Identity,\n ))\n }\n }\n\n let sender = RedirectWithCookiesSender { request_count: request_count_clone };\n let transaction = HttpTransaction::with_cookie_store(sender, cookie_store);\n\n let request = SendableHttpRequest {\n url: \"https://example.com/start\".to_string(),\n method: \"GET\".to_string(),\n headers: vec![],\n options: crate::types::SendableHttpRequestOptions {\n follow_redirects: true,\n ..Default::default()\n },\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await;\n assert!(result.is_ok());\n assert_eq!(request_count.load(Ordering::SeqCst), 2);\n }\n\n #[tokio::test]\n async fn test_cross_origin_redirect_strips_auth_headers() {\n // Redirect from api.example.com -> s3.amazonaws.com should strip Authorization\n let responses = vec![\n MockResponse {\n status: 302,\n headers: vec![(\n \"Location\".to_string(),\n \"https://s3.amazonaws.com/bucket/file.pdf\".to_string(),\n )],\n body: vec![],\n },\n MockResponse { status: 200, headers: Vec::new(), body: b\"PDF content\".to_vec() },\n ];\n\n let sender = MockSender::new(responses);\n let captured = sender.captured_requests.clone();\n let transaction = HttpTransaction::new(sender);\n\n let request = SendableHttpRequest {\n url: \"https://api.example.com/download\".to_string(),\n method: \"GET\".to_string(),\n headers: vec![\n (\"Authorization\".to_string(), \"Basic dXNlcjpwYXNz\".to_string()),\n (\"Accept\".to_string(), \"application/pdf\".to_string()),\n ],\n options: crate::types::SendableHttpRequestOptions {\n follow_redirects: true,\n ..Default::default()\n },\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await.unwrap();\n assert_eq!(result.status, 200);\n\n let requests = captured.lock().await;\n assert_eq!(requests.len(), 2);\n\n // First request should have the Authorization header\n assert!(\n requests[0].headers.iter().any(|(k, _)| k.eq_ignore_ascii_case(\"authorization\")),\n \"First request should have Authorization header\"\n );\n\n // Second request (to different host) should NOT have the Authorization header\n assert!(\n !requests[1].headers.iter().any(|(k, _)| k.eq_ignore_ascii_case(\"authorization\")),\n \"Redirected request to different host should NOT have Authorization header\"\n );\n\n // Non-sensitive headers should still be present\n assert!(\n requests[1].headers.iter().any(|(k, _)| k.eq_ignore_ascii_case(\"accept\")),\n \"Non-sensitive headers should be preserved across cross-origin redirects\"\n );\n }\n\n #[tokio::test]\n async fn test_same_origin_redirect_preserves_auth_headers() {\n // Redirect within the same host should keep Authorization\n let responses = vec![\n MockResponse {\n status: 302,\n headers: vec![(\n \"Location\".to_string(),\n \"https://api.example.com/v2/download\".to_string(),\n )],\n body: vec![],\n },\n MockResponse { status: 200, headers: Vec::new(), body: b\"OK\".to_vec() },\n ];\n\n let sender = MockSender::new(responses);\n let captured = sender.captured_requests.clone();\n let transaction = HttpTransaction::new(sender);\n\n let request = SendableHttpRequest {\n url: \"https://api.example.com/v1/download\".to_string(),\n method: \"GET\".to_string(),\n headers: vec![\n (\"Authorization\".to_string(), \"Bearer token123\".to_string()),\n (\"Accept\".to_string(), \"application/json\".to_string()),\n ],\n options: crate::types::SendableHttpRequestOptions {\n follow_redirects: true,\n ..Default::default()\n },\n ..Default::default()\n };\n\n let (_tx, rx) = tokio::sync::watch::channel(false);\n let (event_tx, _event_rx) = mpsc::channel(100);\n let result = transaction.execute_with_cancellation(request, rx, event_tx).await.unwrap();\n assert_eq!(result.status, 200);\n\n let requests = captured.lock().await;\n assert_eq!(requests.len(), 2);\n\n // Both requests should have the Authorization header (same host)\n assert!(\n requests[0].headers.iter().any(|(k, _)| k.eq_ignore_ascii_case(\"authorization\")),\n \"First request should have Authorization header\"\n );\n assert!(\n requests[1].headers.iter().any(|(k, _)| k.eq_ignore_ascii_case(\"authorization\")),\n \"Redirected request to same host should preserve Authorization header\"\n );\n }\n}\n" }, { "path": "crates/yaak-http/src/types.rs", "content": "use crate::chained_reader::{ChainedReader, ReaderType};\nuse crate::error::Error::RequestError;\nuse crate::error::Result;\nuse crate::path_placeholders::apply_path_placeholders;\nuse crate::proto::ensure_proto;\nuse bytes::Bytes;\nuse log::warn;\nuse std::collections::BTreeMap;\nuse std::pin::Pin;\nuse std::time::Duration;\nuse tokio::io::AsyncRead;\nuse yaak_common::serde::{get_bool, get_bool_map, get_str, get_str_map};\nuse yaak_models::models::HttpRequest;\nuse yaak_templates::strip_json_comments::{maybe_strip_json_comments, strip_json_comments};\n\npub(crate) const MULTIPART_BOUNDARY: &str = \"------YaakFormBoundary\";\n\npub enum SendableBody {\n Bytes(Bytes),\n Stream {\n data: Pin>,\n /// Known content length for the stream, if available. This is used by\n /// the sender to set the body size hint so that hyper can set\n /// Content-Length automatically for both HTTP/1.1 and HTTP/2.\n content_length: Option,\n },\n}\n\nenum SendableBodyWithMeta {\n Bytes(Bytes),\n Stream {\n data: Pin>,\n content_length: Option,\n },\n}\n\nimpl From for SendableBody {\n fn from(value: SendableBodyWithMeta) -> Self {\n match value {\n SendableBodyWithMeta::Bytes(b) => SendableBody::Bytes(b),\n SendableBodyWithMeta::Stream { data, content_length } => {\n SendableBody::Stream { data, content_length: content_length.map(|l| l as u64) }\n }\n }\n }\n}\n\n#[derive(Default)]\npub struct SendableHttpRequest {\n pub url: String,\n pub method: String,\n pub headers: Vec<(String, String)>,\n pub body: Option,\n pub options: SendableHttpRequestOptions,\n}\n\n#[derive(Default, Clone)]\npub struct SendableHttpRequestOptions {\n pub timeout: Option,\n pub follow_redirects: bool,\n}\n\nimpl SendableHttpRequest {\n pub async fn from_http_request(\n r: &HttpRequest,\n options: SendableHttpRequestOptions,\n ) -> Result {\n let initial_headers = build_headers(r);\n let (body, headers) = build_body(&r.method, &r.body_type, &r.body, initial_headers).await?;\n\n Ok(Self {\n url: build_url(r),\n method: r.method.to_uppercase(),\n headers,\n body: body.into(),\n options,\n })\n }\n\n pub fn insert_header(&mut self, header: (String, String)) {\n if let Some(existing) =\n self.headers.iter_mut().find(|h| h.0.to_lowercase() == header.0.to_lowercase())\n {\n existing.1 = header.1;\n } else {\n self.headers.push(header);\n }\n }\n}\n\npub fn append_query_params(url: &str, params: Vec<(String, String)>) -> String {\n let url_string = url.to_string();\n if params.is_empty() {\n return url.to_string();\n }\n\n // Build query string\n let query_string = params\n .iter()\n .map(|(name, value)| {\n format!(\"{}={}\", urlencoding::encode(name), urlencoding::encode(value))\n })\n .collect::>()\n .join(\"&\");\n\n // Split URL into parts: base URL, query, and fragment\n let (base_and_query, fragment) = if let Some(hash_pos) = url_string.find('#') {\n let (before_hash, after_hash) = url_string.split_at(hash_pos);\n (before_hash.to_string(), Some(after_hash.to_string()))\n } else {\n (url_string, None)\n };\n\n // Now handle query parameters on the base URL (without fragment)\n let mut result = if base_and_query.contains('?') {\n // Check if there's already a query string after the '?'\n let parts: Vec<&str> = base_and_query.splitn(2, '?').collect();\n if parts.len() == 2 && !parts[1].trim().is_empty() {\n // Append with & if there are existing parameters\n format!(\"{}&{}\", base_and_query, query_string)\n } else {\n // Just append the new parameters directly (URL ends with '?')\n format!(\"{}{}\", base_and_query, query_string)\n }\n } else {\n // No existing query parameters, add with '?'\n format!(\"{}?{}\", base_and_query, query_string)\n };\n\n // Re-append the fragment if it exists\n if let Some(fragment) = fragment {\n result.push_str(&fragment);\n }\n\n result\n}\n\nfn strip_query_params(url: &str, names: &[&str]) -> String {\n // Split off fragment\n let (base_and_query, fragment) = if let Some(hash_pos) = url.find('#') {\n (&url[..hash_pos], Some(&url[hash_pos..]))\n } else {\n (url, None)\n };\n\n let result = if let Some(q_pos) = base_and_query.find('?') {\n let base = &base_and_query[..q_pos];\n let query = &base_and_query[q_pos + 1..];\n let filtered: Vec<&str> = query\n .split('&')\n .filter(|pair| {\n let key = pair.split('=').next().unwrap_or(\"\");\n let decoded = urlencoding::decode(key).unwrap_or_default();\n !names.contains(&decoded.as_ref())\n })\n .collect();\n if filtered.is_empty() {\n base.to_string()\n } else {\n format!(\"{}?{}\", base, filtered.join(\"&\"))\n }\n } else {\n base_and_query.to_string()\n };\n\n match fragment {\n Some(f) => format!(\"{}{}\", result, f),\n None => result,\n }\n}\n\nfn build_url(r: &HttpRequest) -> String {\n let (url_string, params) = apply_path_placeholders(&ensure_proto(&r.url), &r.url_parameters);\n let mut url = append_query_params(\n &url_string,\n params\n .iter()\n .filter(|p| p.enabled && !p.name.is_empty())\n .map(|p| (p.name.clone(), p.value.clone()))\n .collect(),\n );\n\n // GraphQL GET requests encode query/variables as URL query parameters\n if r.method.to_lowercase() == \"get\" && r.body_type.as_deref() == Some(\"graphql\") {\n url = append_graphql_query_params(&url, &r.body);\n }\n\n url\n}\n\nfn append_graphql_query_params(url: &str, body: &BTreeMap) -> String {\n let query = get_str_map(body, \"query\").to_string();\n let variables = strip_json_comments(&get_str_map(body, \"variables\"));\n let mut params = vec![(\"query\".to_string(), query)];\n if !variables.trim().is_empty() {\n params.push((\"variables\".to_string(), variables));\n }\n // Strip existing query/variables params to avoid duplicates\n let url = strip_query_params(url, &[\"query\", \"variables\"]);\n append_query_params(&url, params)\n}\n\nfn build_headers(r: &HttpRequest) -> Vec<(String, String)> {\n r.headers\n .iter()\n .filter_map(|h| {\n if h.enabled && !h.name.is_empty() {\n Some((h.name.clone(), h.value.clone()))\n } else {\n None\n }\n })\n .collect()\n}\n\nasync fn build_body(\n method: &str,\n body_type: &Option,\n body: &BTreeMap,\n headers: Vec<(String, String)>,\n) -> Result<(Option, Vec<(String, String)>)> {\n let body_type = match &body_type {\n None => return Ok((None, headers)),\n Some(t) => t,\n };\n\n let (body, content_type) = match body_type.as_str() {\n \"binary\" => (build_binary_body(&body).await?, None),\n \"graphql\" => (build_graphql_body(&method, &body), Some(\"application/json\".to_string())),\n \"application/x-www-form-urlencoded\" => {\n (build_form_body(&body), Some(\"application/x-www-form-urlencoded\".to_string()))\n }\n \"multipart/form-data\" => build_multipart_body(&body, &headers).await?,\n _ if body.contains_key(\"text\") => (build_text_body(&body, body_type), None),\n t => {\n warn!(\"Unsupported body type: {}\", t);\n (None, None)\n }\n };\n\n // Add or update the Content-Type header\n let mut headers = headers;\n if let Some(ct) = content_type {\n if let Some(existing) = headers.iter_mut().find(|h| h.0.to_lowercase() == \"content-type\") {\n existing.1 = ct;\n } else {\n headers.push((\"Content-Type\".to_string(), ct));\n }\n }\n\n // NOTE: Content-Length is NOT set as an explicit header here. Instead, the\n // body's content length is carried via SendableBody::Stream { content_length }\n // and used by the sender to set the body size hint. This lets hyper handle\n // Content-Length automatically for both HTTP/1.1 and HTTP/2, avoiding the\n // duplicate Content-Length that breaks HTTP/2 servers.\n\n Ok((body.map(|b| b.into()), headers))\n}\n\nfn build_form_body(body: &BTreeMap) -> Option {\n let form_params = match body.get(\"form\").map(|f| f.as_array()) {\n Some(Some(f)) => f,\n _ => return None,\n };\n\n let mut body = String::new();\n for p in form_params {\n let enabled = get_bool(p, \"enabled\", true);\n let name = get_str(p, \"name\");\n if !enabled || name.is_empty() {\n continue;\n }\n let value = get_str(p, \"value\");\n if !body.is_empty() {\n body.push('&');\n }\n body.push_str(&urlencoding::encode(&name));\n body.push('=');\n body.push_str(&urlencoding::encode(&value));\n }\n\n if body.is_empty() { None } else { Some(SendableBodyWithMeta::Bytes(Bytes::from(body))) }\n}\n\nasync fn build_binary_body(\n body: &BTreeMap,\n) -> Result> {\n let file_path = match body.get(\"filePath\").map(|f| f.as_str()) {\n Some(Some(f)) => f,\n _ => return Ok(None),\n };\n\n // Open a file for streaming\n let content_length = tokio::fs::metadata(file_path)\n .await\n .map_err(|e| RequestError(format!(\"Failed to get file metadata: {}\", e)))?\n .len();\n\n let file = tokio::fs::File::open(file_path)\n .await\n .map_err(|e| RequestError(format!(\"Failed to open file: {}\", e)))?;\n\n Ok(Some(SendableBodyWithMeta::Stream {\n data: Box::pin(file),\n content_length: Some(content_length as usize),\n }))\n}\n\nfn build_text_body(body: &BTreeMap, body_type: &str) -> Option {\n let text = get_str_map(body, \"text\");\n if text.is_empty() {\n return None;\n }\n\n let send_comments = get_bool_map(body, \"sendJsonComments\", false);\n let text = if !send_comments && body_type == \"application/json\" {\n maybe_strip_json_comments(text)\n } else {\n text.to_string()\n };\n\n Some(SendableBodyWithMeta::Bytes(Bytes::from(text)))\n}\n\nfn build_graphql_body(\n method: &str,\n body: &BTreeMap,\n) -> Option {\n let query = get_str_map(body, \"query\");\n let variables = strip_json_comments(&get_str_map(body, \"variables\"));\n\n if method.to_lowercase() == \"get\" {\n // GraphQL GET requests use query parameters, not a body\n return None;\n }\n\n let body = if variables.trim().is_empty() {\n format!(r#\"{{\"query\":{}}}\"#, serde_json::to_string(&query).unwrap_or_default())\n } else {\n format!(\n r#\"{{\"query\":{},\"variables\":{}}}\"#,\n serde_json::to_string(&query).unwrap_or_default(),\n variables\n )\n };\n\n Some(SendableBodyWithMeta::Bytes(Bytes::from(body)))\n}\n\nasync fn build_multipart_body(\n body: &BTreeMap,\n headers: &Vec<(String, String)>,\n) -> Result<(Option, Option)> {\n let boundary = extract_boundary_from_headers(headers);\n\n let form_params = match body.get(\"form\").map(|f| f.as_array()) {\n Some(Some(f)) => f,\n _ => return Ok((None, None)),\n };\n\n // Build a list of readers for streaming and calculate total content length\n let mut readers: Vec = Vec::new();\n let mut has_content = false;\n let mut total_size: usize = 0;\n\n for p in form_params {\n let enabled = get_bool(p, \"enabled\", true);\n let name = get_str(p, \"name\");\n if !enabled || name.is_empty() {\n continue;\n }\n\n has_content = true;\n\n // Add boundary delimiter\n let boundary_bytes = format!(\"--{}\\r\\n\", boundary).into_bytes();\n total_size += boundary_bytes.len();\n readers.push(ReaderType::Bytes(boundary_bytes));\n\n let file_path = get_str(p, \"file\");\n let value = get_str(p, \"value\");\n let content_type = get_str(p, \"contentType\");\n\n if file_path.is_empty() {\n // Text field\n let header = if !content_type.is_empty() {\n format!(\n \"Content-Disposition: form-data; name=\\\"{}\\\"\\r\\nContent-Type: {}\\r\\n\\r\\n{}\",\n name, content_type, value\n )\n } else {\n format!(\"Content-Disposition: form-data; name=\\\"{}\\\"\\r\\n\\r\\n{}\", name, value)\n };\n let header_bytes = header.into_bytes();\n total_size += header_bytes.len();\n readers.push(ReaderType::Bytes(header_bytes));\n } else {\n // File field - validate that file exists first\n if !tokio::fs::try_exists(file_path).await.unwrap_or(false) {\n return Err(RequestError(format!(\"File not found: {}\", file_path)));\n }\n\n // Get file size for content length calculation\n let file_metadata = tokio::fs::metadata(file_path)\n .await\n .map_err(|e| RequestError(format!(\"Failed to get file metadata: {}\", e)))?;\n let file_size = file_metadata.len() as usize;\n\n let filename = get_str(p, \"filename\");\n let filename = if filename.is_empty() {\n std::path::Path::new(file_path)\n .file_name()\n .and_then(|n| n.to_str())\n .unwrap_or(\"file\")\n } else {\n filename\n };\n\n // Add content type\n let mime_type = if !content_type.is_empty() {\n content_type.to_string()\n } else {\n // Guess mime type from file extension\n mime_guess::from_path(file_path).first_or_octet_stream().to_string()\n };\n\n let header = format!(\n \"Content-Disposition: form-data; name=\\\"{}\\\"; filename=\\\"{}\\\"\\r\\nContent-Type: {}\\r\\n\\r\\n\",\n name, filename, mime_type\n );\n let header_bytes = header.into_bytes();\n total_size += header_bytes.len();\n total_size += file_size;\n readers.push(ReaderType::Bytes(header_bytes));\n\n // Add a file path for streaming\n readers.push(ReaderType::FilePath(file_path.to_string()));\n }\n\n let line_ending = b\"\\r\\n\".to_vec();\n total_size += line_ending.len();\n readers.push(ReaderType::Bytes(line_ending));\n }\n\n if has_content {\n // Add the final boundary\n let final_boundary = format!(\"--{}--\\r\\n\", boundary).into_bytes();\n total_size += final_boundary.len();\n readers.push(ReaderType::Bytes(final_boundary));\n\n let content_type = format!(\"multipart/form-data; boundary={}\", boundary);\n let stream = ChainedReader::new(readers);\n Ok((\n Some(SendableBodyWithMeta::Stream {\n data: Box::pin(stream),\n content_length: Some(total_size),\n }),\n Some(content_type),\n ))\n } else {\n Ok((None, None))\n }\n}\n\nfn extract_boundary_from_headers(headers: &Vec<(String, String)>) -> String {\n headers\n .iter()\n .find(|h| h.0.to_lowercase() == \"content-type\")\n .and_then(|h| {\n // Extract boundary from the Content-Type header (e.g., \"multipart/form-data; boundary=xyz\")\n h.1.split(';')\n .find(|part| part.trim().starts_with(\"boundary=\"))\n .and_then(|boundary_part| boundary_part.split('=').nth(1))\n .map(|b| b.trim().to_string())\n })\n .unwrap_or_else(|| MULTIPART_BOUNDARY.to_string())\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n use bytes::Bytes;\n use serde_json::json;\n use std::collections::BTreeMap;\n use yaak_models::models::{HttpRequest, HttpUrlParameter};\n\n #[test]\n fn test_build_url_no_params() {\n let r = HttpRequest {\n url: \"https://example.com/api\".to_string(),\n url_parameters: vec![],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api\");\n }\n\n #[test]\n fn test_build_url_with_params() {\n let r = HttpRequest {\n url: \"https://example.com/api\".to_string(),\n url_parameters: vec![\n HttpUrlParameter {\n enabled: true,\n name: \"foo\".to_string(),\n value: \"bar\".to_string(),\n id: None,\n },\n HttpUrlParameter {\n enabled: true,\n name: \"baz\".to_string(),\n value: \"qux\".to_string(),\n id: None,\n },\n ],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api?foo=bar&baz=qux\");\n }\n\n #[test]\n fn test_build_url_with_disabled_params() {\n let r = HttpRequest {\n url: \"https://example.com/api\".to_string(),\n url_parameters: vec![\n HttpUrlParameter {\n enabled: false,\n name: \"disabled\".to_string(),\n value: \"value\".to_string(),\n id: None,\n },\n HttpUrlParameter {\n enabled: true,\n name: \"enabled\".to_string(),\n value: \"value\".to_string(),\n id: None,\n },\n ],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api?enabled=value\");\n }\n\n #[test]\n fn test_build_url_with_existing_query() {\n let r = HttpRequest {\n url: \"https://example.com/api?existing=param\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"new\".to_string(),\n value: \"value\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api?existing=param&new=value\");\n }\n\n #[test]\n fn test_build_url_with_empty_existing_query() {\n let r = HttpRequest {\n url: \"https://example.com/api?\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"new\".to_string(),\n value: \"value\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api?new=value\");\n }\n\n #[test]\n fn test_build_url_with_special_chars() {\n let r = HttpRequest {\n url: \"https://example.com/api\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"special chars!@#\".to_string(),\n value: \"value with spaces & symbols\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(\n result,\n \"https://example.com/api?special%20chars%21%40%23=value%20with%20spaces%20%26%20symbols\"\n );\n }\n\n #[test]\n fn test_build_url_adds_protocol() {\n let r = HttpRequest {\n url: \"example.com/api\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"foo\".to_string(),\n value: \"bar\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n // ensure_proto defaults to http:// for regular domains\n assert_eq!(result, \"http://example.com/api?foo=bar\");\n }\n\n #[test]\n fn test_build_url_adds_https_for_dev_domain() {\n let r = HttpRequest {\n url: \"example.dev/api\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"foo\".to_string(),\n value: \"bar\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n // .dev domains force https\n assert_eq!(result, \"https://example.dev/api?foo=bar\");\n }\n\n #[test]\n fn test_build_url_with_fragment() {\n let r = HttpRequest {\n url: \"https://example.com/api#section\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"foo\".to_string(),\n value: \"bar\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api?foo=bar#section\");\n }\n\n #[test]\n fn test_build_url_with_existing_query_and_fragment() {\n let r = HttpRequest {\n url: \"https://yaak.app?foo=bar#some-hash\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"baz\".to_string(),\n value: \"qux\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://yaak.app?foo=bar&baz=qux#some-hash\");\n }\n\n #[test]\n fn test_build_url_with_empty_query_and_fragment() {\n let r = HttpRequest {\n url: \"https://example.com/api?#section\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"foo\".to_string(),\n value: \"bar\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api?foo=bar#section\");\n }\n\n #[test]\n fn test_build_url_with_fragment_containing_special_chars() {\n let r = HttpRequest {\n url: \"https://example.com#section/with/slashes?and=fake&query\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"real\".to_string(),\n value: \"param\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com?real=param#section/with/slashes?and=fake&query\");\n }\n\n #[test]\n fn test_build_url_preserves_empty_fragment() {\n let r = HttpRequest {\n url: \"https://example.com/api#\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"foo\".to_string(),\n value: \"bar\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n assert_eq!(result, \"https://example.com/api?foo=bar#\");\n }\n\n #[test]\n fn test_build_url_with_multiple_fragments() {\n // Testing edge case where the URL has multiple # characters (though technically invalid)\n let r = HttpRequest {\n url: \"https://example.com#section#subsection\".to_string(),\n url_parameters: vec![HttpUrlParameter {\n enabled: true,\n name: \"foo\".to_string(),\n value: \"bar\".to_string(),\n id: None,\n }],\n ..Default::default()\n };\n\n let result = build_url(&r);\n // Should treat everything after first # as fragment\n assert_eq!(result, \"https://example.com?foo=bar#section#subsection\");\n }\n\n #[tokio::test]\n async fn test_text_body() {\n let mut body = BTreeMap::new();\n body.insert(\"text\".to_string(), json!(\"Hello, World!\"));\n\n let result = build_text_body(&body, \"application/json\");\n match result {\n Some(SendableBodyWithMeta::Bytes(bytes)) => {\n assert_eq!(bytes, Bytes::from(\"Hello, World!\"))\n }\n _ => panic!(\"Expected Some(SendableBody::Bytes)\"),\n }\n }\n\n #[tokio::test]\n async fn test_text_body_empty() {\n let mut body = BTreeMap::new();\n body.insert(\"text\".to_string(), json!(\"\"));\n\n let result = build_text_body(&body, \"application/json\");\n assert!(result.is_none());\n }\n\n #[tokio::test]\n async fn test_text_body_missing() {\n let body = BTreeMap::new();\n\n let result = build_text_body(&body, \"application/json\");\n assert!(result.is_none());\n }\n\n #[tokio::test]\n async fn test_text_body_strips_json_comments_by_default() {\n let mut body = BTreeMap::new();\n body.insert(\"text\".to_string(), json!(\"{\\n // comment\\n \\\"foo\\\": \\\"bar\\\"\\n}\"));\n\n let result = build_text_body(&body, \"application/json\");\n match result {\n Some(SendableBodyWithMeta::Bytes(bytes)) => {\n let text = String::from_utf8_lossy(&bytes);\n assert!(!text.contains(\"// comment\"));\n assert!(text.contains(\"\\\"foo\\\": \\\"bar\\\"\"));\n }\n _ => panic!(\"Expected Some(SendableBody::Bytes)\"),\n }\n }\n\n #[tokio::test]\n async fn test_text_body_send_json_comments_when_opted_in() {\n let mut body = BTreeMap::new();\n body.insert(\"text\".to_string(), json!(\"{\\n // comment\\n \\\"foo\\\": \\\"bar\\\"\\n}\"));\n body.insert(\"sendJsonComments\".to_string(), json!(true));\n\n let result = build_text_body(&body, \"application/json\");\n match result {\n Some(SendableBodyWithMeta::Bytes(bytes)) => {\n let text = String::from_utf8_lossy(&bytes);\n assert!(text.contains(\"// comment\"));\n }\n _ => panic!(\"Expected Some(SendableBody::Bytes)\"),\n }\n }\n\n #[tokio::test]\n async fn test_text_body_no_strip_for_non_json() {\n let mut body = BTreeMap::new();\n body.insert(\"text\".to_string(), json!(\"// not json\\nsome text\"));\n\n let result = build_text_body(&body, \"text/plain\");\n match result {\n Some(SendableBodyWithMeta::Bytes(bytes)) => {\n let text = String::from_utf8_lossy(&bytes);\n assert!(text.contains(\"// not json\"));\n }\n _ => panic!(\"Expected Some(SendableBody::Bytes)\"),\n }\n }\n\n #[tokio::test]\n async fn test_form_urlencoded_body() -> Result<()> {\n let mut body = BTreeMap::new();\n body.insert(\n \"form\".to_string(),\n json!([\n { \"enabled\": true, \"name\": \"basic\", \"value\": \"aaa\"},\n { \"enabled\": true, \"name\": \"fUnkey Stuff!$*#(\", \"value\": \"*)%&#$)@ *$#)@&\"},\n { \"enabled\": false, \"name\": \"disabled\", \"value\": \"won't show\"},\n ]),\n );\n\n let result = build_form_body(&body);\n match result {\n Some(SendableBodyWithMeta::Bytes(bytes)) => {\n let expected = \"basic=aaa&fUnkey%20Stuff%21%24%2A%23%28=%2A%29%25%26%23%24%29%40%20%2A%24%23%29%40%26\";\n assert_eq!(bytes, Bytes::from(expected));\n }\n _ => panic!(\"Expected Some(SendableBody::Bytes)\"),\n }\n Ok(())\n }\n\n #[tokio::test]\n async fn test_form_urlencoded_body_missing_form() {\n let body = BTreeMap::new();\n let result = build_form_body(&body);\n assert!(result.is_none());\n }\n\n #[tokio::test]\n async fn test_binary_body() -> Result<()> {\n let mut body = BTreeMap::new();\n body.insert(\"filePath\".to_string(), json!(\"./tests/test.txt\"));\n\n let result = build_binary_body(&body).await?;\n assert!(matches!(result, Some(SendableBodyWithMeta::Stream { .. })));\n Ok(())\n }\n\n #[tokio::test]\n async fn test_binary_body_file_not_found() {\n let mut body = BTreeMap::new();\n body.insert(\"filePath\".to_string(), json!(\"./nonexistent/file.txt\"));\n\n let result = build_binary_body(&body).await;\n assert!(result.is_err());\n if let Err(e) = result {\n assert!(matches!(e, RequestError(_)));\n }\n }\n\n #[tokio::test]\n async fn test_graphql_body_with_variables() {\n let mut body = BTreeMap::new();\n body.insert(\"query\".to_string(), json!(\"{ user(id: $id) { name } }\"));\n body.insert(\"variables\".to_string(), json!(r#\"{\"id\": \"123\"}\"#));\n\n let result = build_graphql_body(\"POST\", &body);\n match result {\n Some(SendableBodyWithMeta::Bytes(bytes)) => {\n let expected =\n r#\"{\"query\":\"{ user(id: $id) { name } }\",\"variables\":{\"id\": \"123\"}}\"#;\n assert_eq!(bytes, Bytes::from(expected));\n }\n _ => panic!(\"Expected Some(SendableBody::Bytes)\"),\n }\n }\n\n #[tokio::test]\n async fn test_graphql_body_without_variables() {\n let mut body = BTreeMap::new();\n body.insert(\"query\".to_string(), json!(\"{ users { name } }\"));\n body.insert(\"variables\".to_string(), json!(\"\"));\n\n let result = build_graphql_body(\"POST\", &body);\n match result {\n Some(SendableBodyWithMeta::Bytes(bytes)) => {\n let expected = r#\"{\"query\":\"{ users { name } }\"}\"#;\n assert_eq!(bytes, Bytes::from(expected));\n }\n _ => panic!(\"Expected Some(SendableBody::Bytes)\"),\n }\n }\n\n #[tokio::test]\n async fn test_graphql_body_get_method() {\n let mut body = BTreeMap::new();\n body.insert(\"query\".to_string(), json!(\"{ users { name } }\"));\n\n let result = build_graphql_body(\"GET\", &body);\n assert!(result.is_none());\n }\n\n #[tokio::test]\n async fn test_multipart_body_text_fields() -> Result<()> {\n let mut body = BTreeMap::new();\n body.insert(\n \"form\".to_string(),\n json!([\n { \"enabled\": true, \"name\": \"field1\", \"value\": \"value1\", \"file\": \"\" },\n { \"enabled\": true, \"name\": \"field2\", \"value\": \"value2\", \"file\": \"\" },\n { \"enabled\": false, \"name\": \"disabled\", \"value\": \"won't show\", \"file\": \"\" },\n ]),\n );\n\n let (result, content_type) = build_multipart_body(&body, &vec![]).await?;\n assert!(content_type.is_some());\n\n match result {\n Some(SendableBodyWithMeta::Stream { data: mut stream, content_length }) => {\n // Read the entire stream to verify content\n let mut buf = Vec::new();\n use tokio::io::AsyncReadExt;\n stream.read_to_end(&mut buf).await.expect(\"Failed to read stream\");\n let body_str = String::from_utf8_lossy(&buf);\n assert_eq!(\n body_str,\n \"--------YaakFormBoundary\\r\\nContent-Disposition: form-data; name=\\\"field1\\\"\\r\\n\\r\\nvalue1\\r\\n--------YaakFormBoundary\\r\\nContent-Disposition: form-data; name=\\\"field2\\\"\\r\\n\\r\\nvalue2\\r\\n--------YaakFormBoundary--\\r\\n\",\n );\n assert_eq!(content_length, Some(body_str.len()));\n }\n _ => panic!(\"Expected Some(SendableBody::Stream)\"),\n }\n\n assert_eq!(\n content_type.unwrap(),\n format!(\"multipart/form-data; boundary={}\", MULTIPART_BOUNDARY)\n );\n\n Ok(())\n }\n\n #[tokio::test]\n async fn test_multipart_body_with_file() -> Result<()> {\n let mut body = BTreeMap::new();\n body.insert(\n \"form\".to_string(),\n json!([\n { \"enabled\": true, \"name\": \"file_field\", \"file\": \"./tests/test.txt\", \"filename\": \"custom.txt\", \"contentType\": \"text/plain\" },\n ]),\n );\n\n let (result, content_type) = build_multipart_body(&body, &vec![]).await?;\n assert!(content_type.is_some());\n\n match result {\n Some(SendableBodyWithMeta::Stream { data: mut stream, content_length }) => {\n // Read the entire stream to verify content\n let mut buf = Vec::new();\n use tokio::io::AsyncReadExt;\n stream.read_to_end(&mut buf).await.expect(\"Failed to read stream\");\n let body_str = String::from_utf8_lossy(&buf);\n assert_eq!(\n body_str,\n \"--------YaakFormBoundary\\r\\nContent-Disposition: form-data; name=\\\"file_field\\\"; filename=\\\"custom.txt\\\"\\r\\nContent-Type: text/plain\\r\\n\\r\\nThis is a test file!\\n\\r\\n--------YaakFormBoundary--\\r\\n\"\n );\n assert_eq!(content_length, Some(body_str.len()));\n }\n _ => panic!(\"Expected Some(SendableBody::Stream)\"),\n }\n\n assert_eq!(\n content_type.unwrap(),\n format!(\"multipart/form-data; boundary={}\", MULTIPART_BOUNDARY)\n );\n\n Ok(())\n }\n\n #[tokio::test]\n async fn test_multipart_body_empty() -> Result<()> {\n let body = BTreeMap::new();\n let (result, content_type) = build_multipart_body(&body, &vec![]).await?;\n assert!(result.is_none());\n assert_eq!(content_type, None);\n Ok(())\n }\n\n #[test]\n fn test_extract_boundary_from_headers_with_custom_boundary() {\n let headers = vec![(\n \"Content-Type\".to_string(),\n \"multipart/form-data; boundary=customBoundary123\".to_string(),\n )];\n let boundary = extract_boundary_from_headers(&headers);\n assert_eq!(boundary, \"customBoundary123\");\n }\n\n #[test]\n fn test_extract_boundary_from_headers_default() {\n let headers = vec![(\"Accept\".to_string(), \"*/*\".to_string())];\n let boundary = extract_boundary_from_headers(&headers);\n assert_eq!(boundary, MULTIPART_BOUNDARY);\n }\n\n #[test]\n fn test_extract_boundary_from_headers_no_boundary_in_content_type() {\n let headers = vec![(\"Content-Type\".to_string(), \"multipart/form-data\".to_string())];\n let boundary = extract_boundary_from_headers(&headers);\n assert_eq!(boundary, MULTIPART_BOUNDARY);\n }\n\n #[test]\n fn test_extract_boundary_case_insensitive() {\n let headers = vec![(\n \"Content-Type\".to_string(),\n \"multipart/form-data; boundary=myBoundary\".to_string(),\n )];\n let boundary = extract_boundary_from_headers(&headers);\n assert_eq!(boundary, \"myBoundary\");\n }\n\n #[tokio::test]\n async fn test_no_content_length_header_added_by_build_body() -> Result<()> {\n let mut body = BTreeMap::new();\n body.insert(\"text\".to_string(), json!(\"Hello, World!\"));\n\n let headers = vec![];\n\n let (_, result_headers) =\n build_body(\"POST\", &Some(\"text/plain\".to_string()), &body, headers).await?;\n\n // Content-Length should NOT be set as an explicit header. Instead, the\n // sender uses the body's size_hint to let hyper set it automatically,\n // which works correctly for both HTTP/1.1 and HTTP/2.\n let has_content_length =\n result_headers.iter().any(|h| h.0.to_lowercase() == \"content-length\");\n assert!(!has_content_length, \"Content-Length should not be set as an explicit header\");\n\n Ok(())\n }\n\n #[tokio::test]\n async fn test_chunked_encoding_header_preserved() -> Result<()> {\n let mut body = BTreeMap::new();\n body.insert(\"text\".to_string(), json!(\"Hello, World!\"));\n\n // Headers with Transfer-Encoding: chunked\n let headers = vec![(\"Transfer-Encoding\".to_string(), \"chunked\".to_string())];\n\n let (_, result_headers) =\n build_body(\"POST\", &Some(\"text/plain\".to_string()), &body, headers).await?;\n\n // Verify that the Transfer-Encoding header is still present\n let has_chunked = result_headers.iter().any(|h| {\n h.0.to_lowercase() == \"transfer-encoding\" && h.1.to_lowercase().contains(\"chunked\")\n });\n assert!(has_chunked, \"Transfer-Encoding: chunked should be preserved\");\n\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-http/tests/test.txt", "content": "This is a test file!\n" }, { "path": "crates/yaak-models/Cargo.toml", "content": "[package]\nname = \"yaak-models\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nchrono = { version = \"0.4.38\", features = [\"serde\"] }\nhex = { workspace = true }\ninclude_dir = \"0.7\"\nlog = { workspace = true }\nnanoid = \"0.4.0\"\nr2d2 = \"0.8.10\"\nr2d2_sqlite = { version = \"0.25.0\" }\nrusqlite = { version = \"0.32.1\", features = [\"bundled\", \"chrono\"] }\nsea-query = { version = \"0.32.1\", features = [\"with-chrono\", \"attr\"] }\nsea-query-rusqlite = { version = \"0.7.0\", features = [\"with-chrono\"] }\nserde = { workspace = true, features = [\"derive\"] }\nserde_json = { workspace = true }\nschemars = { workspace = true }\nsha2 = { workspace = true }\nthiserror = { workspace = true }\nts-rs = { workspace = true, features = [\"chrono-impl\", \"serde-json-impl\"] }\nyaak-core = { workspace = true }\n" }, { "path": "crates/yaak-models/bindings/gen_models.ts", "content": "// This file was generated by [ts-rs](https://github.com/Aleph-Alpha/ts-rs). Do not edit this file manually.\n\nexport type AnyModel = CookieJar | Environment | Folder | GraphQlIntrospection | GrpcConnection | GrpcEvent | GrpcRequest | HttpRequest | HttpResponse | HttpResponseEvent | KeyValue | Plugin | Settings | SyncState | WebsocketConnection | WebsocketEvent | WebsocketRequest | Workspace | WorkspaceMeta;\n\nexport type ClientCertificate = { host: string, port: number | null, crtFile: string | null, keyFile: string | null, pfxFile: string | null, passphrase: string | null, enabled?: boolean, };\n\nexport type Cookie = { raw_cookie: string, domain: CookieDomain, expires: CookieExpires, path: [string, boolean], };\n\nexport type CookieDomain = { \"HostOnly\": string } | { \"Suffix\": string } | \"NotPresent\" | \"Empty\";\n\nexport type CookieExpires = { \"AtUtc\": string } | \"SessionEnd\";\n\nexport type CookieJar = { model: \"cookie_jar\", id: string, createdAt: string, updatedAt: string, workspaceId: string, cookies: Array, name: string, };\n\nexport type DnsOverride = { hostname: string, ipv4: Array, ipv6: Array, enabled?: boolean, };\n\nexport type EditorKeymap = \"default\" | \"vim\" | \"vscode\" | \"emacs\";\n\nexport type EncryptedKey = { encryptedKey: string, };\n\nexport type Environment = { model: \"environment\", id: string, workspaceId: string, createdAt: string, updatedAt: string, name: string, public: boolean, parentModel: string, parentId: string | null, variables: Array, color: string | null, sortPriority: number, };\n\nexport type EnvironmentVariable = { enabled?: boolean, name: string, value: string, id?: string, };\n\nexport type Folder = { model: \"folder\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authentication: Record, authenticationType: string | null, description: string, headers: Array, name: string, sortPriority: number, };\n\nexport type GraphQlIntrospection = { model: \"graphql_introspection\", id: string, createdAt: string, updatedAt: string, workspaceId: string, requestId: string, content: string | null, };\n\nexport type GrpcConnection = { model: \"grpc_connection\", id: string, createdAt: string, updatedAt: string, workspaceId: string, requestId: string, elapsed: number, error: string | null, method: string, service: string, status: number, state: GrpcConnectionState, trailers: { [key in string]?: string }, url: string, };\n\nexport type GrpcConnectionState = \"initialized\" | \"connected\" | \"closed\";\n\nexport type GrpcEvent = { model: \"grpc_event\", id: string, createdAt: string, updatedAt: string, workspaceId: string, requestId: string, connectionId: string, content: string, error: string | null, eventType: GrpcEventType, metadata: { [key in string]?: string }, status: number | null, };\n\nexport type GrpcEventType = \"info\" | \"error\" | \"client_message\" | \"server_message\" | \"connection_start\" | \"connection_end\";\n\nexport type GrpcRequest = { model: \"grpc_request\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authenticationType: string | null, authentication: Record, description: string, message: string, metadata: Array, method: string | null, name: string, service: string | null, sortPriority: number, url: string, };\n\nexport type HttpRequest = { model: \"http_request\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authentication: Record, authenticationType: string | null, body: Record, bodyType: string | null, description: string, headers: Array, method: string, name: string, sortPriority: number, url: string, urlParameters: Array, };\n\nexport type HttpRequestHeader = { enabled?: boolean, name: string, value: string, id?: string, };\n\nexport type HttpResponse = { model: \"http_response\", id: string, createdAt: string, updatedAt: string, workspaceId: string, requestId: string, bodyPath: string | null, contentLength: number | null, contentLengthCompressed: number | null, elapsed: number, elapsedHeaders: number, elapsedDns: number, error: string | null, headers: Array, remoteAddr: string | null, requestContentLength: number | null, requestHeaders: Array, status: number, statusReason: string | null, state: HttpResponseState, url: string, version: string | null, };\n\nexport type HttpResponseEvent = { model: \"http_response_event\", id: string, createdAt: string, updatedAt: string, workspaceId: string, responseId: string, event: HttpResponseEventData, };\n\n/**\n * Serializable representation of HTTP response events for DB storage.\n * This mirrors `yaak_http::sender::HttpResponseEvent` but with serde support.\n * The `From` impl is in yaak-http to avoid circular dependencies.\n */\nexport type HttpResponseEventData = { \"type\": \"setting\", name: string, value: string, } | { \"type\": \"info\", message: string, } | { \"type\": \"redirect\", url: string, status: number, behavior: string, dropped_body: boolean, dropped_headers: Array, } | { \"type\": \"send_url\", method: string, scheme: string, username: string, password: string, host: string, port: number, path: string, query: string, fragment: string, } | { \"type\": \"receive_url\", version: string, status: string, } | { \"type\": \"header_up\", name: string, value: string, } | { \"type\": \"header_down\", name: string, value: string, } | { \"type\": \"chunk_sent\", bytes: number, } | { \"type\": \"chunk_received\", bytes: number, } | { \"type\": \"dns_resolved\", hostname: string, addresses: Array, duration: bigint, overridden: boolean, };\n\nexport type HttpResponseHeader = { name: string, value: string, };\n\nexport type HttpResponseState = \"initialized\" | \"connected\" | \"closed\";\n\nexport type HttpUrlParameter = { enabled?: boolean, name: string, value: string, id?: string, };\n\nexport type KeyValue = { model: \"key_value\", id: string, createdAt: string, updatedAt: string, key: string, namespace: string, value: string, };\n\nexport type ModelChangeEvent = { \"type\": \"upsert\", created: boolean, } | { \"type\": \"delete\" };\n\nexport type ModelPayload = { model: AnyModel, updateSource: UpdateSource, change: ModelChangeEvent, };\n\nexport type ParentAuthentication = { authentication: Record, authenticationType: string | null, };\n\nexport type ParentHeaders = { headers: Array, };\n\nexport type Plugin = { model: \"plugin\", id: string, createdAt: string, updatedAt: string, checkedAt: string | null, directory: string, enabled: boolean, url: string | null, source: PluginSource, };\n\nexport type PluginSource = \"bundled\" | \"filesystem\" | \"registry\";\n\nexport type PluginKeyValue = { model: \"plugin_key_value\", createdAt: string, updatedAt: string, pluginName: string, key: string, value: string, };\n\nexport type ProxySetting = { \"type\": \"enabled\", http: string, https: string, auth: ProxySettingAuth | null, bypass: string, disabled: boolean, } | { \"type\": \"disabled\" };\n\nexport type ProxySettingAuth = { user: string, password: string, };\n\nexport type Settings = { model: \"settings\", id: string, createdAt: string, updatedAt: string, appearance: string, clientCertificates: Array, coloredMethods: boolean, editorFont: string | null, editorFontSize: number, editorKeymap: EditorKeymap, editorSoftWrap: boolean, hideWindowControls: boolean, useNativeTitlebar: boolean, interfaceFont: string | null, interfaceFontSize: number, interfaceScale: number, openWorkspaceNewWindow: boolean | null, proxy: ProxySetting | null, themeDark: string, themeLight: string, updateChannel: string, hideLicenseBadge: boolean, autoupdate: boolean, autoDownloadUpdates: boolean, checkNotifications: boolean, hotkeys: { [key in string]?: Array }, };\n\nexport type SyncState = { model: \"sync_state\", id: string, workspaceId: string, createdAt: string, updatedAt: string, flushedAt: string, modelId: string, checksum: string, relPath: string, syncDir: string, };\n\nexport type UpdateSource = { \"type\": \"background\" } | { \"type\": \"import\" } | { \"type\": \"plugin\" } | { \"type\": \"sync\" } | { \"type\": \"window\", label: string, };\n\nexport type WebsocketConnection = { model: \"websocket_connection\", id: string, createdAt: string, updatedAt: string, workspaceId: string, requestId: string, elapsed: number, error: string | null, headers: Array, state: WebsocketConnectionState, status: number, url: string, };\n\nexport type WebsocketConnectionState = \"initialized\" | \"connected\" | \"closing\" | \"closed\";\n\nexport type WebsocketEvent = { model: \"websocket_event\", id: string, createdAt: string, updatedAt: string, workspaceId: string, requestId: string, connectionId: string, isServer: boolean, message: Array, messageType: WebsocketEventType, };\n\nexport type WebsocketEventType = \"binary\" | \"close\" | \"frame\" | \"open\" | \"ping\" | \"pong\" | \"text\";\n\nexport type WebsocketMessageType = \"text\" | \"binary\";\n\nexport type WebsocketRequest = { model: \"websocket_request\", id: string, createdAt: string, updatedAt: string, workspaceId: string, folderId: string | null, authentication: Record, authenticationType: string | null, description: string, headers: Array, message: string, name: string, sortPriority: number, url: string, urlParameters: Array, };\n\nexport type Workspace = { model: \"workspace\", id: string, createdAt: string, updatedAt: string, authentication: Record, authenticationType: string | null, description: string, headers: Array, name: string, encryptionKeyChallenge: string | null, settingValidateCertificates: boolean, settingFollowRedirects: boolean, settingRequestTimeout: number, settingDnsOverrides: Array, };\n\nexport type WorkspaceMeta = { model: \"workspace_meta\", id: string, workspaceId: string, createdAt: string, updatedAt: string, encryptionKey: EncryptedKey | null, settingSyncDir: string | null, };\n" }, { "path": "crates/yaak-models/bindings/gen_util.ts", "content": "// This file was generated by [ts-rs](https://github.com/Aleph-Alpha/ts-rs). Do not edit this file manually.\nimport type { Environment, Folder, GrpcRequest, HttpRequest, WebsocketRequest, Workspace } from \"./gen_models\";\n\nexport type BatchUpsertResult = { workspaces: Array, environments: Array, folders: Array, httpRequests: Array, grpcRequests: Array, websocketRequests: Array, };\n" }, { "path": "crates/yaak-models/blob_migrations/00000000000000_init.sql", "content": "CREATE TABLE body_chunks\n(\n id TEXT PRIMARY KEY,\n body_id TEXT NOT NULL,\n chunk_index INTEGER NOT NULL,\n data BLOB NOT NULL,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n\n UNIQUE (body_id, chunk_index)\n);\n\nCREATE INDEX idx_body_chunks_body_id ON body_chunks (body_id, chunk_index);\n" }, { "path": "crates/yaak-models/build.rs", "content": "fn main() {\n // Migrations are embedded with include_dir!, so trigger rebuilds when SQL files change.\n println!(\"cargo:rerun-if-changed=migrations\");\n println!(\"cargo:rerun-if-changed=blob_migrations\");\n}\n" }, { "path": "crates/yaak-models/guest-js/atoms.ts", "content": "import { atom } from \"jotai\";\n\nimport { selectAtom } from \"jotai/utils\";\nimport type { AnyModel } from \"../bindings/gen_models\";\nimport { ExtractModel } from \"./types\";\nimport { newStoreData } from \"./util\";\n\nexport const modelStoreDataAtom = atom(newStoreData());\n\nexport const cookieJarsAtom = createOrderedModelAtom(\"cookie_jar\", \"name\", \"asc\");\nexport const environmentsAtom = createOrderedModelAtom(\"environment\", \"sortPriority\", \"asc\");\nexport const foldersAtom = createModelAtom(\"folder\");\nexport const grpcConnectionsAtom = createOrderedModelAtom(\"grpc_connection\", \"createdAt\", \"desc\");\nexport const grpcEventsAtom = createOrderedModelAtom(\"grpc_event\", \"createdAt\", \"asc\");\nexport const grpcRequestsAtom = createModelAtom(\"grpc_request\");\nexport const httpRequestsAtom = createModelAtom(\"http_request\");\nexport const httpResponsesAtom = createOrderedModelAtom(\"http_response\", \"createdAt\", \"desc\");\nexport const httpResponseEventsAtom = createOrderedModelAtom(\n \"http_response_event\",\n \"createdAt\",\n \"asc\",\n);\nexport const keyValuesAtom = createModelAtom(\"key_value\");\nexport const pluginsAtom = createModelAtom(\"plugin\");\nexport const settingsAtom = createSingularModelAtom(\"settings\");\nexport const websocketRequestsAtom = createModelAtom(\"websocket_request\");\nexport const websocketEventsAtom = createOrderedModelAtom(\"websocket_event\", \"createdAt\", \"asc\");\nexport const websocketConnectionsAtom = createOrderedModelAtom(\n \"websocket_connection\",\n \"createdAt\",\n \"desc\",\n);\nexport const workspaceMetasAtom = createModelAtom(\"workspace_meta\");\nexport const workspacesAtom = createOrderedModelAtom(\"workspace\", \"name\", \"asc\");\n\nexport function createModelAtom(modelType: M) {\n return selectAtom(\n modelStoreDataAtom,\n (data) => Object.values(data[modelType] ?? {}),\n shallowEqual,\n );\n}\n\nexport function createSingularModelAtom(modelType: M) {\n return selectAtom(modelStoreDataAtom, (data) => {\n const modelData = Object.values(data[modelType] ?? {});\n const item = modelData[0];\n if (item == null) throw new Error(\"Failed creating singular model with no data: \" + modelType);\n return item;\n });\n}\n\nexport function createOrderedModelAtom(\n modelType: M,\n field: keyof ExtractModel,\n order: \"asc\" | \"desc\",\n) {\n return selectAtom(\n modelStoreDataAtom,\n (data) => {\n const modelData = data[modelType] ?? {};\n return Object.values(modelData).sort(\n (a: ExtractModel, b: ExtractModel) => {\n const n = a[field] > b[field] ? 1 : -1;\n return order === \"desc\" ? n * -1 : n;\n },\n );\n },\n shallowEqual,\n );\n}\n\nfunction shallowEqual(a: T[], b: T[]): boolean {\n if (a.length !== b.length) {\n return false;\n }\n\n for (let i = 0; i < a.length; i++) {\n if (a[i] !== b[i]) {\n return false;\n }\n }\n\n return true;\n}\n" }, { "path": "crates/yaak-models/guest-js/index.ts", "content": "import { AnyModel } from \"../bindings/gen_models\";\n\nexport * from \"../bindings/gen_models\";\nexport * from \"../bindings/gen_util\";\nexport * from \"./store\";\nexport * from \"./atoms\";\n\nexport function modelTypeLabel(m: AnyModel): string {\n const capitalize = (str: string) => str.charAt(0).toUpperCase() + str.slice(1);\n return m.model.split(\"_\").map(capitalize).join(\" \");\n}\n" }, { "path": "crates/yaak-models/guest-js/store.ts", "content": "import { invoke } from \"@tauri-apps/api/core\";\nimport { getCurrentWebviewWindow } from \"@tauri-apps/api/webviewWindow\";\nimport { resolvedModelName } from \"@yaakapp/app/lib/resolvedModelName\";\nimport { AnyModel, ModelPayload } from \"../bindings/gen_models\";\nimport { modelStoreDataAtom } from \"./atoms\";\nimport { ExtractModel, JotaiStore, ModelStoreData } from \"./types\";\nimport { newStoreData } from \"./util\";\n\nlet _store: JotaiStore | null = null;\n\nexport function initModelStore(store: JotaiStore) {\n _store = store;\n\n getCurrentWebviewWindow()\n .listen(\"model_write\", ({ payload }) => {\n if (shouldIgnoreModel(payload)) return;\n\n mustStore().set(modelStoreDataAtom, (prev: ModelStoreData) => {\n if (payload.change.type === \"upsert\") {\n return {\n ...prev,\n [payload.model.model]: {\n ...prev[payload.model.model],\n [payload.model.id]: payload.model,\n },\n };\n } else {\n const modelData = { ...prev[payload.model.model] };\n delete modelData[payload.model.id];\n return { ...prev, [payload.model.model]: modelData };\n }\n });\n })\n .catch(console.error);\n}\n\nfunction mustStore(): JotaiStore {\n if (_store == null) {\n throw new Error(\"Model store was not initialized\");\n }\n\n return _store;\n}\n\nlet _activeWorkspaceId: string | null = null;\n\nexport async function changeModelStoreWorkspace(workspaceId: string | null) {\n console.log(\"Syncing models with new workspace\", workspaceId);\n const workspaceModelsStr = await invoke(\"models_workspace_models\", {\n workspaceId, // NOTE: if no workspace id provided, it will just fetch global models\n });\n const workspaceModels = JSON.parse(workspaceModelsStr) as AnyModel[];\n const data = newStoreData();\n for (const model of workspaceModels) {\n data[model.model][model.id] = model;\n }\n\n mustStore().set(modelStoreDataAtom, data);\n\n console.log(\"Synced model store with workspace\", workspaceId, data);\n\n _activeWorkspaceId = workspaceId;\n}\n\nexport function listModels>(\n modelType: M | ReadonlyArray,\n): T[] {\n let data = mustStore().get(modelStoreDataAtom);\n const types: ReadonlyArray = Array.isArray(modelType) ? modelType : [modelType];\n return types.flatMap((t) => Object.values(data[t]) as T[]);\n}\n\nexport function getModel>(\n modelType: M | ReadonlyArray,\n id: string,\n): T | null {\n let data = mustStore().get(modelStoreDataAtom);\n const types: ReadonlyArray = Array.isArray(modelType) ? modelType : [modelType];\n for (const t of types) {\n let v = data[t][id];\n if (v?.model === t) return v as T;\n }\n return null;\n}\n\nexport function getAnyModel(id: string): AnyModel | null {\n let data = mustStore().get(modelStoreDataAtom);\n for (const t of Object.keys(data)) {\n // oxlint-disable-next-line no-explicit-any\n let v = (data as any)[t]?.[id];\n if (v?.model === t) return v;\n }\n return null;\n}\n\nexport function patchModelById>(\n model: M,\n id: string,\n patch: Partial | ((prev: T) => T),\n): Promise {\n let prev = getModel(model, id);\n if (prev == null) {\n throw new Error(`Failed to get model to patch id=${id} model=${model}`);\n }\n\n const newModel = typeof patch === \"function\" ? patch(prev) : { ...prev, ...patch };\n return updateModel(newModel);\n}\n\nexport async function patchModel>(\n base: Pick,\n patch: Partial,\n): Promise {\n return patchModelById(base.model, base.id, patch);\n}\n\nexport async function updateModel>(\n model: T,\n): Promise {\n return invoke(\"models_upsert\", { model });\n}\n\nexport async function deleteModelById<\n M extends AnyModel[\"model\"],\n T extends ExtractModel,\n>(modelType: M | M[], id: string) {\n let model = getModel(modelType, id);\n await deleteModel(model);\n}\n\nexport async function deleteModel>(\n model: T | null,\n) {\n if (model == null) {\n throw new Error(\"Failed to delete null model\");\n }\n await invoke(\"models_delete\", { model });\n}\n\nexport function duplicateModel>(\n model: T | null,\n) {\n if (model == null) {\n throw new Error(\"Failed to duplicate null model\");\n }\n\n // If the model has a name, try to duplicate it with a name that doesn't conflict\n let name = \"name\" in model ? resolvedModelName(model) : undefined;\n if (name != null) {\n const existingModels = listModels(model.model);\n for (let i = 0; i < 100; i++) {\n const hasConflict = existingModels.some((m) => {\n if (\"folderId\" in m && \"folderId\" in model && model.folderId !== m.folderId) {\n return false;\n } else if (resolvedModelName(m) !== name) {\n return false;\n }\n return true;\n });\n if (!hasConflict) {\n break;\n }\n\n // Name conflict. Try another one\n const m: RegExpMatchArray | null = name.match(/ Copy( (?\\d+))?$/);\n if (m != null && m.groups?.n == null) {\n name = name.substring(0, m.index) + \" Copy 2\";\n } else if (m != null && m.groups?.n != null) {\n name = name.substring(0, m.index) + ` Copy ${parseInt(m.groups.n) + 1}`;\n } else {\n name = `${name} Copy`;\n }\n }\n }\n\n return invoke(\"models_duplicate\", { model: { ...model, name } });\n}\n\nexport async function createGlobalModel>(\n patch: Partial & Pick,\n): Promise {\n return invoke(\"models_upsert\", { model: patch });\n}\n\nexport async function createWorkspaceModel>(\n patch: Partial & Pick,\n): Promise {\n return invoke(\"models_upsert\", { model: patch });\n}\n\nexport function replaceModelsInStore<\n M extends AnyModel[\"model\"],\n T extends Extract,\n>(model: M, models: T[]) {\n const newModels: Record = {};\n for (const model of models) {\n newModels[model.id] = model;\n }\n\n mustStore().set(modelStoreDataAtom, (prev: ModelStoreData) => {\n return {\n ...prev,\n [model]: newModels,\n };\n });\n}\n\nexport function mergeModelsInStore<\n M extends AnyModel[\"model\"],\n T extends Extract,\n>(model: M, models: T[], filter?: (model: T) => boolean) {\n mustStore().set(modelStoreDataAtom, (prev: ModelStoreData) => {\n const existingModels = { ...prev[model] } as Record;\n\n // Merge in new models first\n for (const m of models) {\n existingModels[m.id] = m;\n }\n\n // Then filter out unwanted models\n if (filter) {\n for (const [id, m] of Object.entries(existingModels)) {\n if (!filter(m)) {\n delete existingModels[id];\n }\n }\n }\n\n return {\n ...prev,\n [model]: existingModels,\n };\n });\n}\n\nfunction shouldIgnoreModel({ model, updateSource }: ModelPayload) {\n // Never ignore updates from non-user sources\n if (updateSource.type !== \"window\") {\n return false;\n }\n\n // Never ignore same-window updates\n if (updateSource.label === getCurrentWebviewWindow().label) {\n return false;\n }\n\n // Only sync models that belong to this workspace, if a workspace ID is present\n if (\"workspaceId\" in model && model.workspaceId !== _activeWorkspaceId) {\n return true;\n }\n\n if (model.model === \"key_value\" && model.namespace === \"no_sync\") {\n return true;\n }\n\n return false;\n}\n" }, { "path": "crates/yaak-models/guest-js/types.ts", "content": "import { createStore } from \"jotai\";\nimport { AnyModel } from \"../bindings/gen_models\";\n\nexport type ExtractModel = T extends { model: M } ? T : never;\nexport type ModelStoreData = {\n [M in T[\"model\"]]: Record>;\n};\nexport type JotaiStore = ReturnType;\n" }, { "path": "crates/yaak-models/guest-js/util.ts", "content": "import { ModelStoreData } from \"./types\";\n\nexport function newStoreData(): ModelStoreData {\n return {\n cookie_jar: {},\n environment: {},\n folder: {},\n graphql_introspection: {},\n grpc_connection: {},\n grpc_event: {},\n grpc_request: {},\n http_request: {},\n http_response: {},\n http_response_event: {},\n key_value: {},\n plugin: {},\n settings: {},\n sync_state: {},\n websocket_connection: {},\n websocket_event: {},\n websocket_request: {},\n workspace: {},\n workspace_meta: {},\n };\n}\n" }, { "path": "crates/yaak-models/migrations/20230225181302_init.sql", "content": "CREATE TABLE key_values\n(\n model TEXT DEFAULT 'key_value' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n namespace TEXT NOT NULL,\n key TEXT NOT NULL,\n value TEXT NOT NULL,\n PRIMARY KEY (namespace, key)\n);\n\nCREATE TABLE workspaces\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'workspace' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n name TEXT NOT NULL,\n description TEXT NOT NULL\n);\n\nCREATE TABLE http_requests\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'http_request' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n name TEXT NOT NULL,\n url TEXT NOT NULL,\n method TEXT NOT NULL,\n headers TEXT NOT NULL,\n body TEXT,\n body_type TEXT\n);\n\nCREATE TABLE http_responses\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'http_response' NOT NULL,\n request_id TEXT NOT NULL\n REFERENCES http_requests\n ON DELETE CASCADE,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n elapsed INTEGER NOT NULL,\n status INTEGER NOT NULL,\n status_reason TEXT,\n url TEXT NOT NULL,\n body TEXT NOT NULL,\n headers TEXT NOT NULL,\n error TEXT\n);\n" }, { "path": "crates/yaak-models/migrations/20230319042610_sort-priority.sql", "content": "ALTER TABLE main.http_requests ADD COLUMN sort_priority REAL NOT NULL DEFAULT 0;\n" }, { "path": "crates/yaak-models/migrations/20230330143214_request-auth.sql", "content": "ALTER TABLE http_requests ADD COLUMN authentication TEXT NOT NULL DEFAULT '{}';\nALTER TABLE http_requests ADD COLUMN authentication_type TEXT;\n" }, { "path": "crates/yaak-models/migrations/20230413232435_response-body-blob.sql", "content": "DELETE FROM main.http_responses;\nALTER TABLE http_responses DROP COLUMN body;\nALTER TABLE http_responses ADD COLUMN body BLOB;\nALTER TABLE http_responses ADD COLUMN body_path TEXT;\nALTER TABLE http_responses ADD COLUMN content_length INTEGER;\n" }, { "path": "crates/yaak-models/migrations/20231022205109_environments.sql", "content": "CREATE TABLE environments\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'workspace' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n name TEXT NOT NULL,\n data TEXT NOT NULL\n DEFAULT '{}'\n);\n" }, { "path": "crates/yaak-models/migrations/20231028161007_variables.sql", "content": "ALTER TABLE environments DROP COLUMN data;\nALTER TABLE environments ADD COLUMN variables DEFAULT '[]' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20231103004111_workspace-variables.sql", "content": "ALTER TABLE workspaces ADD COLUMN variables DEFAULT '[]' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20231103142807_folders.sql", "content": "CREATE TABLE folders\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'folder' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n folder_id TEXT NULL\n REFERENCES folders\n ON DELETE CASCADE,\n name TEXT NOT NULL,\n sort_priority REAL DEFAULT 0 NOT NULL\n);\n\nALTER TABLE http_requests ADD COLUMN folder_id TEXT REFERENCES folders(id) ON DELETE CASCADE;\n" }, { "path": "crates/yaak-models/migrations/20231112180500_body_object.sql", "content": "-- Rename old column to backup name\nALTER TABLE http_requests\n RENAME COLUMN body TO body_old;\n\n-- Create desired new body column\nALTER TABLE http_requests\n ADD COLUMN body TEXT NOT NULL DEFAULT '{}';\n\n-- Copy data from old to new body, in new JSON format\nUPDATE http_requests\nSET body = CASE WHEN body_old IS NULL THEN '{}' ELSE JSON_OBJECT('text', body_old) END\nWHERE TRUE;\n\n-- Drop old column\nALTER TABLE http_requests\n DROP COLUMN body_old;\n" }, { "path": "crates/yaak-models/migrations/20231113183810_url_params.sql", "content": "ALTER TABLE http_requests\n ADD COLUMN url_parameters TEXT NOT NULL DEFAULT '[]';\n" }, { "path": "crates/yaak-models/migrations/20231122055216_remove_body.sql", "content": "ALTER TABLE http_responses DROP COLUMN body;\n" }, { "path": "crates/yaak-models/migrations/20240111221224_settings.sql", "content": "CREATE TABLE settings\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'settings' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n follow_redirects BOOLEAN DEFAULT TRUE NOT NULL,\n validate_certificates BOOLEAN DEFAULT TRUE NOT NULL,\n request_timeout INTEGER DEFAULT 0 NOT NULL,\n theme TEXT DEFAULT 'default' NOT NULL,\n appearance TEXT DEFAULT 'system' NOT NULL\n);\n" }, { "path": "crates/yaak-models/migrations/20240115193751_workspace_settings.sql", "content": "-- Add existing request-related settings to workspace\nALTER TABLE workspaces ADD COLUMN setting_request_timeout INTEGER DEFAULT '0' NOT NULL;\nALTER TABLE workspaces ADD COLUMN setting_validate_certificates BOOLEAN DEFAULT TRUE NOT NULL;\nALTER TABLE workspaces ADD COLUMN setting_follow_redirects BOOLEAN DEFAULT TRUE NOT NULL;\n\n-- Remove old settings that used to be global\nALTER TABLE settings DROP COLUMN request_timeout;\nALTER TABLE settings DROP COLUMN follow_redirects;\nALTER TABLE settings DROP COLUMN validate_certificates;\n" }, { "path": "crates/yaak-models/migrations/20240118181105_channel_setting.sql", "content": "ALTER TABLE settings ADD COLUMN update_channel TEXT DEFAULT 'stable' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20240127013915_cookies.sql", "content": "CREATE TABLE cookie_jars\n(\n id TEXT NOT NULL PRIMARY KEY,\n model TEXT DEFAULT 'cookie_jar' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n name TEXT NOT NULL,\n cookies TEXT DEFAULT '[]' NOT NULL,\n workspace_id TEXT NOT NULL\n);\n" }, { "path": "crates/yaak-models/migrations/20240128230717_more_response_attrs.sql", "content": "ALTER TABLE http_responses ADD COLUMN elapsed_headers INTEGER NOT NULL DEFAULT 0;\nALTER TABLE http_responses ADD COLUMN remote_addr TEXT;\nALTER TABLE http_responses ADD COLUMN version TEXT;\n" }, { "path": "crates/yaak-models/migrations/20240203164833_grpc.sql", "content": "CREATE TABLE grpc_requests\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'grpc_request' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n folder_id TEXT NULL\n REFERENCES folders\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n updated_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n name TEXT NOT NULL,\n sort_priority REAL NOT NULL,\n url TEXT NOT NULL,\n service TEXT NULL,\n method TEXT NULL,\n message TEXT NOT NULL,\n authentication TEXT DEFAULT '{}' NOT NULL,\n authentication_type TEXT NULL,\n metadata TEXT DEFAULT '[]' NOT NULL\n);\n\nCREATE TABLE grpc_connections\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'grpc_connection' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n request_id TEXT NOT NULL\n REFERENCES grpc_requests\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n updated_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n url TEXT NOT NULL,\n service TEXT NOT NULL,\n method TEXT NOT NULL,\n status INTEGER DEFAULT -1 NOT NULL,\n error TEXT NULL,\n elapsed INTEGER DEFAULT 0 NOT NULL,\n trailers TEXT DEFAULT '{}' NOT NULL\n);\n\nCREATE TABLE grpc_events\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'grpc_event' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n request_id TEXT NOT NULL\n REFERENCES grpc_requests\n ON DELETE CASCADE,\n connection_id TEXT NOT NULL\n REFERENCES grpc_connections\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n updated_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n metadata TEXT DEFAULT '{}' NOT NULL,\n event_type TEXT NOT NULL,\n status INTEGER NULL,\n error TEXT NULL,\n content TEXT NOT NULL\n);\n" }, { "path": "crates/yaak-models/migrations/20240522031045_theme-settings.sql", "content": "ALTER TABLE settings\n ADD COLUMN theme_dark TEXT DEFAULT 'yaak-dark' NOT NULL;\nALTER TABLE settings\n ADD COLUMN theme_light TEXT DEFAULT 'yaak-light' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20240529143147_more-settings.sql", "content": "ALTER TABLE settings ADD COLUMN interface_font_size INTEGER DEFAULT 15 NOT NULL;\nALTER TABLE settings ADD COLUMN interface_scale INTEGER DEFAULT 1 NOT NULL;\nALTER TABLE settings ADD COLUMN editor_font_size INTEGER DEFAULT 13 NOT NULL;\nALTER TABLE settings ADD COLUMN editor_soft_wrap BOOLEAN DEFAULT 1 NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20240607151115_open-workspace-setting.sql", "content": "ALTER TABLE settings ADD COLUMN open_workspace_new_window BOOLEAN NULL DEFAULT NULL;\n" }, { "path": "crates/yaak-models/migrations/20240814013812_fix-env-model.sql", "content": "ALTER TABLE environments DROP COLUMN model;\nALTER TABLE environments ADD COLUMN model TEXT DEFAULT 'environment';\n" }, { "path": "crates/yaak-models/migrations/20240826184943_disable-telemetry.sql", "content": "ALTER TABLE settings ADD COLUMN telemetry BOOLEAN DEFAULT TRUE;\n" }, { "path": "crates/yaak-models/migrations/20240829131004_plugins.sql", "content": "CREATE TABLE plugins\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'plugin' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n checked_at DATETIME NULL,\n enabled BOOLEAN NOT NULL,\n directory TEXT NULL NOT NULL,\n url TEXT NULL\n);\n" }, { "path": "crates/yaak-models/migrations/20241003134208_response-state.sql", "content": "ALTER TABLE http_responses\n ADD COLUMN state TEXT DEFAULT 'closed' NOT NULL;\n\nALTER TABLE grpc_connections\n ADD COLUMN state TEXT DEFAULT 'closed' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20241012181547_proxy-setting.sql", "content": "ALTER TABLE settings ADD COLUMN proxy TEXT;\n" }, { "path": "crates/yaak-models/migrations/20241217204951_docs.sql", "content": "ALTER TABLE http_requests\n ADD COLUMN description TEXT DEFAULT '' NOT NULL;\n\nALTER TABLE grpc_requests\n ADD COLUMN description TEXT DEFAULT '' NOT NULL;\n\nALTER TABLE folders\n ADD COLUMN description TEXT DEFAULT '' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20241219140051_base-environments.sql", "content": "-- Add the new field\nALTER TABLE environments\n ADD COLUMN environment_id TEXT REFERENCES environments (id) ON DELETE CASCADE;\n\n-- Create temporary column so we know which rows are meant to be base environments. We'll use this to update\n-- child environments to point to them.\nALTER TABLE environments\n ADD COLUMN migrated_base_env BOOLEAN DEFAULT FALSE NOT NULL;\n\n-- Create a base environment for each workspace\nINSERT INTO environments (id, workspace_id, name, variables, migrated_base_env)\nSELECT (\n -- This is the best way to generate a random string in SQLite, apparently\n 'ev_' || SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1)\n ),\n workspaces.id,\n 'Global Variables',\n variables,\n TRUE\nFROM workspaces;\n\n-- Update all non-base environments to point to newly created base environments\nUPDATE environments\nSET environment_id = ( SELECT base_env.id\n FROM environments AS base_env\n WHERE base_env.workspace_id = environments.workspace_id\n AND base_env.migrated_base_env IS TRUE )\nWHERE migrated_base_env IS FALSE;\n\n-- Drop temporary column\nALTER TABLE environments\n DROP COLUMN migrated_base_env;\n\n-- Drop the old variables column\n-- IMPORTANT: Skip to give the user the option to roll back to a previous app version. We can drop it once the migration working in the real world\n-- ALTER TABLE workspaces DROP COLUMN variables;\n" }, { "path": "crates/yaak-models/migrations/20250102141937_sync.sql", "content": "ALTER TABLE workspaces\n ADD COLUMN setting_sync_dir TEXT;\n\nCREATE TABLE sync_states\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'sync_state' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n flushed_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n checksum TEXT NOT NULL,\n model_id TEXT NOT NULL,\n sync_dir TEXT NOT NULL,\n rel_path TEXT NOT NULL,\n\n UNIQUE (workspace_id, model_id)\n);\n" }, { "path": "crates/yaak-models/migrations/20250108035425_editor-keymap.sql", "content": "ALTER TABLE settings\n ADD COLUMN editor_keymap TEXT DEFAULT 'codemirror' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20250108205117_workspace-meta.sql", "content": "CREATE TABLE workspace_metas\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'workspace_meta' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n setting_sync_dir TEXT\n);\n" }, { "path": "crates/yaak-models/migrations/20250114160022_remove-workspace-sync-setting.sql", "content": "-- This setting was moved to the new workspace_metas table\nALTER TABLE workspaces DROP COLUMN setting_sync_dir;\n" }, { "path": "crates/yaak-models/migrations/20250123192023_plugin-kv.sql", "content": "CREATE TABLE plugin_key_values\n(\n model TEXT DEFAULT 'plugin_key_value' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n plugin_name TEXT NOT NULL,\n key TEXT NOT NULL,\n value TEXT NOT NULL,\n PRIMARY KEY (plugin_name, key)\n);\n" }, { "path": "crates/yaak-models/migrations/20250128155623_websockets.sql", "content": "CREATE TABLE websocket_requests\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'websocket_request' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n folder_id TEXT\n REFERENCES folders\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n authentication TEXT DEFAULT '{}' NOT NULL,\n authentication_type TEXT,\n description TEXT NOT NULL,\n name TEXT NOT NULL,\n url TEXT NOT NULL,\n headers TEXT NOT NULL,\n message TEXT NOT NULL,\n sort_priority REAL NOT NULL,\n url_parameters TEXT DEFAULT '[]' NOT NULL\n);\n\nCREATE TABLE websocket_connections\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'websocket_connection' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n request_id TEXT NOT NULL\n REFERENCES websocket_requests\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n url TEXT NOT NULL,\n state TEXT NOT NULL,\n status INTEGER DEFAULT -1 NOT NULL,\n error TEXT NULL,\n elapsed INTEGER DEFAULT 0 NOT NULL,\n headers TEXT DEFAULT '{}' NOT NULL\n);\n\nCREATE TABLE websocket_events\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'websocket_event' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n request_id TEXT NOT NULL\n REFERENCES websocket_requests\n ON DELETE CASCADE,\n connection_id TEXT NOT NULL\n REFERENCES websocket_connections\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n updated_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n is_server BOOLEAN NOT NULL,\n message_type TEXT NOT NULL,\n message BLOB NOT NULL\n);\n" }, { "path": "crates/yaak-models/migrations/20250302041707_hide-window-controls.sql", "content": "ALTER TABLE settings\n ADD COLUMN hide_window_controls BOOLEAN DEFAULT FALSE NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20250326193143_key-value-id.sql", "content": "-- 1. Create the new table with `id` as the primary key\nCREATE TABLE key_values_new\n(\n id TEXT PRIMARY KEY,\n model TEXT DEFAULT 'key_value' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n namespace TEXT NOT NULL,\n key TEXT NOT NULL,\n value TEXT NOT NULL\n);\n\n-- 2. Copy data from the old table\nINSERT INTO key_values_new (id, model, created_at, updated_at, deleted_at, namespace, key, value)\nSELECT (\n -- This is the best way to generate a random string in SQLite, apparently\n 'kv_' || SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1) ||\n SUBSTR('abcdefghijkmnopqrstuvwxyzABCDEFGHJKLMNPQRSTUVWXYZ23457789', (ABS(RANDOM()) % 57) + 1, 1)\n ) AS id,\n model,\n created_at,\n updated_at,\n deleted_at,\n namespace,\n key,\n value\nFROM key_values;\n\n-- 3. Drop the old table\nDROP TABLE key_values;\n\n-- 4. Rename the new table\nALTER TABLE key_values_new\n RENAME TO key_values;\n" }, { "path": "crates/yaak-models/migrations/20250401122407_encrypted-key.sql", "content": "ALTER TABLE workspace_metas ADD COLUMN encryption_key TEXT NULL DEFAULT NULL;\n" }, { "path": "crates/yaak-models/migrations/20250402144842_encryption-key-challenge.sql", "content": "ALTER TABLE workspaces ADD COLUMN encryption_key_challenge TEXT NULL;\n" }, { "path": "crates/yaak-models/migrations/20250424152740_remove-fks.sql", "content": "-- NOTE: SQLite does not support dropping foreign keys, so we need to create new\n-- tables and copy data instead. To prevent cascade deletes from wrecking stuff,\n-- we start with the leaf tables and finish with the parent tables (eg. folder).\n\n----------------------------\n-- Remove http request FK --\n----------------------------\n\nCREATE TABLE http_requests_dg_tmp\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'http_request' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n name TEXT NOT NULL,\n url TEXT NOT NULL,\n method TEXT NOT NULL,\n headers TEXT NOT NULL,\n body_type TEXT,\n sort_priority REAL DEFAULT 0 NOT NULL,\n authentication TEXT DEFAULT '{}' NOT NULL,\n authentication_type TEXT,\n folder_id TEXT,\n body TEXT DEFAULT '{}' NOT NULL,\n url_parameters TEXT DEFAULT '[]' NOT NULL,\n description TEXT DEFAULT '' NOT NULL\n);\n\nINSERT INTO http_requests_dg_tmp(id, model, workspace_id, created_at, updated_at, deleted_at, name, url, method,\n headers, body_type, sort_priority, authentication, authentication_type, folder_id,\n body, url_parameters, description)\nSELECT id,\n model,\n workspace_id,\n created_at,\n updated_at,\n deleted_at,\n name,\n url,\n method,\n headers,\n body_type,\n sort_priority,\n authentication,\n authentication_type,\n folder_id,\n body,\n url_parameters,\n description\nFROM http_requests;\n\nDROP TABLE http_requests;\n\nALTER TABLE http_requests_dg_tmp\n RENAME TO http_requests;\n\n----------------------------\n-- Remove grpc request FK --\n----------------------------\n\nCREATE TABLE grpc_requests_dg_tmp\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'grpc_request' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n folder_id TEXT,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n updated_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n name TEXT NOT NULL,\n sort_priority REAL NOT NULL,\n url TEXT NOT NULL,\n service TEXT,\n method TEXT,\n message TEXT NOT NULL,\n authentication TEXT DEFAULT '{}' NOT NULL,\n authentication_type TEXT,\n metadata TEXT DEFAULT '[]' NOT NULL,\n description TEXT DEFAULT '' NOT NULL\n);\n\nINSERT INTO grpc_requests_dg_tmp(id, model, workspace_id, folder_id, created_at, updated_at, name, sort_priority, url,\n service, method, message, authentication, authentication_type, metadata, description)\nSELECT id,\n model,\n workspace_id,\n folder_id,\n created_at,\n updated_at,\n name,\n sort_priority,\n url,\n service,\n method,\n message,\n authentication,\n authentication_type,\n metadata,\n description\nFROM grpc_requests;\n\nDROP TABLE grpc_requests;\n\nALTER TABLE grpc_requests_dg_tmp\n RENAME TO grpc_requests;\n\n---------------------------------\n-- Remove websocket request FK --\n---------------------------------\n\nCREATE TABLE websocket_requests_dg_tmp\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'websocket_request' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n folder_id TEXT,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n authentication TEXT DEFAULT '{}' NOT NULL,\n authentication_type TEXT,\n description TEXT NOT NULL,\n name TEXT NOT NULL,\n url TEXT NOT NULL,\n headers TEXT NOT NULL,\n message TEXT NOT NULL,\n sort_priority REAL NOT NULL,\n url_parameters TEXT DEFAULT '[]' NOT NULL\n);\n\nINSERT INTO websocket_requests_dg_tmp(id, model, workspace_id, folder_id, created_at, updated_at, deleted_at,\n authentication, authentication_type, description, name, url, headers, message,\n sort_priority, url_parameters)\nSELECT id,\n model,\n workspace_id,\n folder_id,\n created_at,\n updated_at,\n deleted_at,\n authentication,\n authentication_type,\n description,\n name,\n url,\n headers,\n message,\n sort_priority,\n url_parameters\nFROM websocket_requests;\n\nDROP TABLE websocket_requests;\n\nALTER TABLE websocket_requests_dg_tmp\n RENAME TO websocket_requests;\n\n---------------------------\n-- Remove environment FK --\n---------------------------\n\nCREATE TABLE environments_dg_tmp\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n name TEXT NOT NULL,\n variables DEFAULT '[]' NOT NULL,\n model TEXT DEFAULT 'environment',\n environment_id TEXT\n);\n\nINSERT INTO environments_dg_tmp(id, created_at, updated_at, deleted_at, workspace_id, name, variables, model,\n environment_id)\nSELECT id,\n created_at,\n updated_at,\n deleted_at,\n workspace_id,\n name,\n variables,\n model,\n environment_id\nFROM environments;\n\nDROP TABLE environments;\n\nALTER TABLE environments_dg_tmp\n RENAME TO environments;\n\n----------------------\n-- Remove folder FK --\n----------------------\n\nCREATE TABLE folders_dg_tmp\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'folder' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n folder_id TEXT,\n name TEXT NOT NULL,\n sort_priority REAL DEFAULT 0 NOT NULL,\n description TEXT DEFAULT '' NOT NULL\n);\n\nINSERT INTO folders_dg_tmp(id, model, created_at, updated_at, deleted_at, workspace_id, folder_id, name, sort_priority,\n description)\nSELECT id,\n model,\n created_at,\n updated_at,\n deleted_at,\n workspace_id,\n folder_id,\n name,\n sort_priority,\n description\nFROM folders;\n\nDROP TABLE folders;\n\nALTER TABLE folders_dg_tmp\n RENAME TO folders;\n" }, { "path": "crates/yaak-models/migrations/20250507140702_remove-ev-sync-states.sql", "content": "-- There used to be sync code that skipped over environments because we didn't\n-- want to sync potentially insecure data. With encryption, it is now possible\n-- to sync environments securely. However, there were already sync states in the\n-- DB that marked environments as \"Synced\". Running the sync code on these envs\n-- would mark them as deleted by FS (exist in SyncState but not on FS).\n--\n-- To undo this mess, we have this migration to delete all environment-related\n-- sync states so we can sync from a clean slate.\nDELETE\nFROM sync_states\nWHERE model_id LIKE 'ev_%';\n" }, { "path": "crates/yaak-models/migrations/20250508161145_public-environments.sql", "content": "-- Add a public column to represent whether an environment can be shared or exported\nALTER TABLE environments\n ADD COLUMN public BOOLEAN DEFAULT FALSE;\n\n-- Add a base column to represent whether an environment is a base or sub environment. We used to\n-- do this with environment_id, but we need a more flexible solution now that envs can be optionally\n-- synced. E.g., it's now possible to only import a sub environment from a different client without\n-- its base environment \"parent.\"\nALTER TABLE environments\n ADD COLUMN base BOOLEAN DEFAULT FALSE;\n\n-- SQLite doesn't support dynamic default values, so we update `base` based on the value of\n-- environment_id.\nUPDATE environments\nSET base = TRUE\nWHERE environment_id IS NULL;\n\n-- Finally, we drop the old `environment_id` column that will no longer be used\nALTER TABLE environments\n DROP COLUMN environment_id;\n" }, { "path": "crates/yaak-models/migrations/20250516182745_default-attrs.sql", "content": "-- Auth\nALTER TABLE workspaces\n ADD COLUMN authentication TEXT NOT NULL DEFAULT '{}';\nALTER TABLE folders\n ADD COLUMN authentication TEXT NOT NULL DEFAULT '{}';\nALTER TABLE workspaces\n ADD COLUMN authentication_type TEXT;\nALTER TABLE folders\n ADD COLUMN authentication_type TEXT;\n\n-- Headers\nALTER TABLE workspaces\n ADD COLUMN headers TEXT NOT NULL DEFAULT '[]';\nALTER TABLE folders\n ADD COLUMN headers TEXT NOT NULL DEFAULT '[]';\n" }, { "path": "crates/yaak-models/migrations/20250530174021_graphql-introspection.sql", "content": "-- Clean up old key/values that are no longer used\nDELETE\nFROM key_values\nWHERE key LIKE 'graphql_introspection::%';\n\nCREATE TABLE graphql_introspections\n(\n\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'graphql_introspection' NOT NULL,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n request_id TEXT NULL\n REFERENCES http_requests\n ON DELETE CASCADE,\n content TEXT NULL\n);\n" }, { "path": "crates/yaak-models/migrations/20250531193722_sync-state-index.sql", "content": "-- Add sync_dir to the unique index, or else it will fail if the user disables sync\n-- and re-enables it for a different directory.\n\n-- Step 1: Rename the existing table\nALTER TABLE sync_states\n RENAME TO sync_states_old;\n\n-- Step 2: Create the new table with the updated unique constraint\nCREATE TABLE sync_states\n(\n id TEXT NOT NULL PRIMARY KEY,\n model TEXT DEFAULT 'sync_state' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces ON DELETE CASCADE,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n flushed_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n checksum TEXT NOT NULL,\n model_id TEXT NOT NULL,\n sync_dir TEXT NOT NULL,\n rel_path TEXT NOT NULL\n);\n\nCREATE UNIQUE INDEX idx_sync_states_unique\n ON sync_states (workspace_id, model_id, sync_dir);\n\n-- Step 3: Copy the data\nINSERT INTO sync_states (id, model, workspace_id, created_at, updated_at,\n flushed_at, checksum, model_id, sync_dir, rel_path)\nSELECT id,\n model,\n workspace_id,\n created_at,\n updated_at,\n flushed_at,\n checksum,\n model_id,\n sync_dir,\n rel_path\nFROM sync_states_old;\n\n-- Step 4: Drop the old table\nDROP TABLE sync_states_old;\n" }, { "path": "crates/yaak-models/migrations/20250604102922_colored-methods-setting.sql", "content": "ALTER TABLE settings\n ADD COLUMN colored_methods BOOLEAN DEFAULT FALSE;\n" }, { "path": "crates/yaak-models/migrations/20250608150053_font-settings.sql", "content": "ALTER TABLE settings ADD COLUMN interface_font TEXT;\nALTER TABLE settings ADD COLUMN editor_font TEXT;\n" }, { "path": "crates/yaak-models/migrations/20250611120000_environment-color.sql", "content": "ALTER TABLE environments ADD COLUMN color TEXT; " }, { "path": "crates/yaak-models/migrations/20250727190746_autoupdate_setting.sql", "content": "ALTER TABLE settings ADD COLUMN autoupdate BOOLEAN DEFAULT true NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20250918141129_request-folder-environments.sql", "content": "-- Create temporary table for migration\nCREATE TABLE environments__new\n(\n id TEXT NOT NULL PRIMARY KEY,\n created_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n updated_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL,\n deleted_at DATETIME,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces ON DELETE CASCADE,\n\n name TEXT NOT NULL,\n variables TEXT DEFAULT '[]' NOT NULL,\n model TEXT DEFAULT 'environment',\n public BOOLEAN DEFAULT FALSE,\n color TEXT,\n\n -- NEW\n parent_model TEXT DEFAULT 'workspace' NOT NULL,\n parent_id TEXT\n);\n\n-- Backfill the data from the old table\n-- - base=1 -> (workspace, NULL)\n-- - base=0 -> (environment, id_of_workspace_base) (fallback to workspace,NULL if none)\nINSERT INTO environments__new\n(id, created_at, updated_at, deleted_at, workspace_id, name, variables, model, public, color, parent_model, parent_id)\nSELECT\n e.id,\n e.created_at,\n e.updated_at,\n e.deleted_at,\n e.workspace_id,\n e.name,\n e.variables,\n e.model,\n e.public,\n e.color,\n CASE\n WHEN e.base = 1 THEN 'workspace'\n WHEN (\n SELECT COUNT(1)\n FROM environments b\n WHERE b.workspace_id = e.workspace_id AND b.base = 1\n ) > 0 THEN 'environment'\n ELSE 'workspace'\n END AS parent_model,\n CASE\n WHEN e.base = 1 THEN NULL\n ELSE (\n SELECT b.id\n FROM environments b\n WHERE b.workspace_id = e.workspace_id AND b.base = 1\n ORDER BY b.created_at ASC, b.id ASC\n LIMIT 1\n )\n END AS parent_id\nFROM environments e;\n\n-- Move everything to the new table\nDROP TABLE environments;\nALTER TABLE environments__new\n RENAME TO environments;\n" }, { "path": "crates/yaak-models/migrations/20250929132954_dismiss-license-badge.sql", "content": "ALTER TABLE settings\n ADD COLUMN hide_license_badge BOOLEAN DEFAULT FALSE;\n\n-- 2. Backfill based on old JSON\nUPDATE settings\nSET hide_license_badge = 1\nWHERE EXISTS ( SELECT 1\n FROM key_values kv\n WHERE kv.key = 'license_confirmation'\n AND JSON_EXTRACT(kv.value, '$.confirmedPersonalUse') = TRUE );\n" }, { "path": "crates/yaak-models/migrations/20251001082054_auto-download.sql", "content": "ALTER TABLE settings\n ADD COLUMN auto_download_updates BOOLEAN DEFAULT TRUE;\n" }, { "path": "crates/yaak-models/migrations/20251028060300_check_notifications_setting.sql", "content": "ALTER TABLE settings ADD COLUMN check_notifications BOOLEAN DEFAULT true NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20251029062024_aws-auth-name.sql", "content": "UPDATE http_requests\nSET authentication_type = 'awsv4'\nWHERE authentication_type = 'auth-aws-sig-v4';\n\nUPDATE folders\nSET authentication_type = 'awsv4'\nWHERE authentication_type = 'auth-aws-sig-v4';\n\nUPDATE workspaces\nSET authentication_type = 'awsv4'\nWHERE authentication_type = 'auth-aws-sig-v4';\n" }, { "path": "crates/yaak-models/migrations/20251031070515_environment-sort-priority.sql", "content": "ALTER TABLE environments\n ADD COLUMN sort_priority REAL DEFAULT 0 NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20251202080000_use-native-titlebar.sql", "content": "-- Add a setting to force native window title bar / controls\nALTER TABLE settings\n ADD COLUMN use_native_titlebar BOOLEAN DEFAULT FALSE NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20251209000000_client-certificates.sql", "content": "ALTER TABLE settings ADD COLUMN client_certificates TEXT DEFAULT '[]' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20251219074602_default-workspace-headers.sql", "content": "-- Add default User-Agent header to workspaces that don't already have one (case-insensitive check)\nUPDATE workspaces\nSET headers = json_insert(headers, '$[#]', json('{\"enabled\":true,\"name\":\"User-Agent\",\"value\":\"yaak\"}'))\nWHERE NOT EXISTS (\n SELECT 1 FROM json_each(workspaces.headers)\n WHERE LOWER(json_extract(value, '$.name')) = 'user-agent'\n);\n\n-- Add default Accept header to workspaces that don't already have one (case-insensitive check)\nUPDATE workspaces\nSET headers = json_insert(headers, '$[#]', json('{\"enabled\":true,\"name\":\"Accept\",\"value\":\"*/*\"}'))\nWHERE NOT EXISTS (\n SELECT 1 FROM json_each(workspaces.headers)\n WHERE LOWER(json_extract(value, '$.name')) = 'accept'\n);\n" }, { "path": "crates/yaak-models/migrations/20251220000000_response-request-headers.sql", "content": "-- Add request_headers and content_length_compressed columns to http_responses table\nALTER TABLE http_responses ADD COLUMN request_headers TEXT NOT NULL DEFAULT '[]';\nALTER TABLE http_responses ADD COLUMN content_length_compressed INTEGER;\n" }, { "path": "crates/yaak-models/migrations/20251221000000_http-response-events.sql", "content": "CREATE TABLE http_response_events\n(\n id TEXT NOT NULL\n PRIMARY KEY,\n model TEXT DEFAULT 'http_response_event' NOT NULL,\n workspace_id TEXT NOT NULL\n REFERENCES workspaces\n ON DELETE CASCADE,\n response_id TEXT NOT NULL\n REFERENCES http_responses\n ON DELETE CASCADE,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n updated_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL,\n event TEXT NOT NULL\n);\n" }, { "path": "crates/yaak-models/migrations/20251221100000_request-content-length.sql", "content": "ALTER TABLE http_responses\n ADD COLUMN request_content_length INTEGER;\n" }, { "path": "crates/yaak-models/migrations/20260104000000_hotkeys.sql", "content": "ALTER TABLE settings ADD COLUMN hotkeys TEXT DEFAULT '{}' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20260111000000_dns-timing.sql", "content": "-- Add DNS resolution timing to http_responses\nALTER TABLE http_responses ADD COLUMN elapsed_dns INTEGER DEFAULT 0 NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20260112000000_dns-overrides.sql", "content": "-- Add DNS overrides setting to workspaces\nALTER TABLE workspaces ADD COLUMN setting_dns_overrides TEXT DEFAULT '[]' NOT NULL;\n" }, { "path": "crates/yaak-models/migrations/20260119045146_remove-default-workspace-headers.sql", "content": "-- Filter out headers that match the hardcoded defaults (User-Agent: yaak, Accept: */*),\n-- keeping any other custom headers the user may have added.\nUPDATE workspaces\nSET headers = (\n SELECT json_group_array(json(value))\n FROM json_each(headers)\n WHERE NOT (\n (LOWER(json_extract(value, '$.name')) = 'user-agent' AND json_extract(value, '$.value') = 'yaak')\n OR (LOWER(json_extract(value, '$.name')) = 'accept' AND json_extract(value, '$.value') = '*/*')\n )\n)\nWHERE json_array_length(headers) > 0;\n" }, { "path": "crates/yaak-models/migrations/20260216000000_model-changes.sql", "content": "CREATE TABLE model_changes\n(\n id INTEGER PRIMARY KEY AUTOINCREMENT,\n model TEXT NOT NULL,\n model_id TEXT NOT NULL,\n change TEXT NOT NULL,\n update_source TEXT NOT NULL,\n payload TEXT NOT NULL,\n created_at DATETIME DEFAULT (STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW')) NOT NULL\n);\n\nCREATE INDEX idx_model_changes_created_at ON model_changes (created_at);\n" }, { "path": "crates/yaak-models/migrations/20260217000000_remove-legacy-faker-plugin.sql", "content": "-- Remove stale plugin rows left over from the brief period when faker shipped as bundled.\nDELETE FROM plugins\nWHERE directory LIKE '%template-function-faker';\n" }, { "path": "crates/yaak-models/migrations/20260301000000_plugin-source-and-unique-directory.sql", "content": "ALTER TABLE plugins\n ADD COLUMN source TEXT DEFAULT 'filesystem' NOT NULL;\n\n-- Existing registry installs have a URL; classify them first.\nUPDATE plugins\nSET source = 'registry'\nWHERE url IS NOT NULL;\n\n-- Best-effort bundled backfill for legacy rows.\nUPDATE plugins\nSET source = 'bundled'\nWHERE source = 'filesystem'\n AND (\n -- Normalize separators so this also works for Windows paths.\n replace(directory, '\\', '/') LIKE '%/vendored/plugins/%'\n OR replace(directory, '\\', '/') LIKE '%/vendored-plugins/%'\n );\n\n-- Keep one row per exact directory before adding uniqueness.\n-- Tie-break by recency.\nWITH ranked AS (SELECT id,\n ROW_NUMBER() OVER (\n PARTITION BY directory\n ORDER BY updated_at DESC,\n created_at DESC\n ) AS row_num\n FROM plugins)\nDELETE\nFROM plugins\nWHERE id IN (SELECT id FROM ranked WHERE row_num > 1);\n\nCREATE UNIQUE INDEX IF NOT EXISTS idx_plugins_directory_unique\n ON plugins (directory);\n" }, { "path": "crates/yaak-models/package.json", "content": "{\n \"name\": \"@yaakapp-internal/models\",\n \"version\": \"1.0.0\",\n \"private\": true,\n \"main\": \"guest-js/index.ts\"\n}\n" }, { "path": "crates/yaak-models/src/blob_manager.rs", "content": "use crate::error::Result;\nuse crate::util::generate_prefixed_id;\nuse include_dir::{Dir, include_dir};\nuse log::{debug, info};\nuse r2d2::Pool;\nuse r2d2_sqlite::SqliteConnectionManager;\nuse rusqlite::{OptionalExtension, params};\nuse std::sync::{Arc, Mutex};\n\nstatic BLOB_MIGRATIONS_DIR: Dir = include_dir!(\"$CARGO_MANIFEST_DIR/blob_migrations\");\n\n/// A chunk of body data stored in the blob database.\n#[derive(Debug, Clone)]\npub struct BodyChunk {\n pub id: String,\n pub body_id: String,\n pub chunk_index: i32,\n pub data: Vec,\n}\n\nimpl BodyChunk {\n pub fn new(body_id: impl Into, chunk_index: i32, data: Vec) -> Self {\n Self { id: generate_prefixed_id(\"bc\"), body_id: body_id.into(), chunk_index, data }\n }\n}\n\n/// Manages the blob database connection pool.\n#[derive(Debug, Clone)]\npub struct BlobManager {\n pool: Arc>>,\n}\n\nimpl BlobManager {\n pub fn new(pool: Pool) -> Self {\n Self { pool: Arc::new(Mutex::new(pool)) }\n }\n\n pub fn connect(&self) -> BlobContext {\n let conn = self\n .pool\n .lock()\n .expect(\"Failed to gain lock on blob DB\")\n .get()\n .expect(\"Failed to get blob DB connection from pool\");\n BlobContext { conn }\n }\n}\n\n/// Context for blob database operations.\npub struct BlobContext {\n conn: r2d2::PooledConnection,\n}\n\nimpl BlobContext {\n /// Insert a single chunk.\n pub fn insert_chunk(&self, chunk: &BodyChunk) -> Result<()> {\n self.conn.execute(\n \"INSERT INTO body_chunks (id, body_id, chunk_index, data) VALUES (?1, ?2, ?3, ?4)\",\n params![chunk.id, chunk.body_id, chunk.chunk_index, chunk.data],\n )?;\n Ok(())\n }\n\n /// Get all chunks for a body, ordered by chunk_index.\n pub fn get_chunks(&self, body_id: &str) -> Result> {\n let mut stmt = self.conn.prepare(\n \"SELECT id, body_id, chunk_index, data FROM body_chunks\n WHERE body_id = ?1 ORDER BY chunk_index ASC\",\n )?;\n\n let chunks = stmt\n .query_map(params![body_id], |row| {\n Ok(BodyChunk {\n id: row.get(0)?,\n body_id: row.get(1)?,\n chunk_index: row.get(2)?,\n data: row.get(3)?,\n })\n })?\n .collect::, _>>()?;\n\n Ok(chunks)\n }\n\n /// Delete all chunks for a body.\n pub fn delete_chunks(&self, body_id: &str) -> Result<()> {\n self.conn.execute(\"DELETE FROM body_chunks WHERE body_id = ?1\", params![body_id])?;\n Ok(())\n }\n\n /// Delete all chunks matching a body_id prefix (e.g., \"rs_abc123.%\" to delete all bodies for a response).\n pub fn delete_chunks_like(&self, body_id_prefix: &str) -> Result<()> {\n self.conn\n .execute(\"DELETE FROM body_chunks WHERE body_id LIKE ?1\", params![body_id_prefix])?;\n Ok(())\n }\n}\n\n/// Get total size of a body without loading data.\nimpl BlobContext {\n pub fn get_body_size(&self, body_id: &str) -> Result {\n let size: i64 = self\n .conn\n .query_row(\n \"SELECT COALESCE(SUM(LENGTH(data)), 0) FROM body_chunks WHERE body_id = ?1\",\n params![body_id],\n |row| row.get(0),\n )\n .unwrap_or(0);\n Ok(size as usize)\n }\n\n /// Check if a body exists.\n pub fn body_exists(&self, body_id: &str) -> Result {\n let count: i64 = self\n .conn\n .query_row(\n \"SELECT COUNT(*) FROM body_chunks WHERE body_id = ?1\",\n params![body_id],\n |row| row.get(0),\n )\n .unwrap_or(0);\n Ok(count > 0)\n }\n}\n\n/// Run migrations for the blob database.\npub fn migrate_blob_db(pool: &Pool) -> Result<()> {\n info!(\"Running blob database migrations\");\n\n // Create migrations tracking table\n pool.get()?.execute(\n \"CREATE TABLE IF NOT EXISTS _blob_migrations (\n version TEXT PRIMARY KEY,\n description TEXT NOT NULL,\n applied_at DATETIME DEFAULT CURRENT_TIMESTAMP NOT NULL\n )\",\n [],\n )?;\n\n // Read and sort all .sql files\n let mut entries: Vec<_> = BLOB_MIGRATIONS_DIR\n .entries()\n .iter()\n .filter(|e| e.path().extension().map(|ext| ext == \"sql\").unwrap_or(false))\n .collect();\n\n entries.sort_by_key(|e| e.path());\n\n let mut ran_migrations = 0;\n for entry in &entries {\n let filename = entry.path().file_name().unwrap().to_str().unwrap();\n let version = filename.split('_').next().unwrap();\n\n // Check if already applied\n let already_applied: Option = pool\n .get()?\n .query_row(\"SELECT 1 FROM _blob_migrations WHERE version = ?\", [version], |r| r.get(0))\n .optional()?;\n\n if already_applied.is_some() {\n debug!(\"Skipping already applied blob migration: {}\", filename);\n continue;\n }\n\n let sql =\n entry.as_file().unwrap().contents_utf8().expect(\"Failed to read blob migration file\");\n\n info!(\"Applying blob migration: {}\", filename);\n let conn = pool.get()?;\n conn.execute_batch(sql)?;\n\n // Record migration\n conn.execute(\n \"INSERT INTO _blob_migrations (version, description) VALUES (?, ?)\",\n params![version, filename],\n )?;\n\n ran_migrations += 1;\n }\n\n if ran_migrations == 0 {\n info!(\"No blob migrations to run\");\n } else {\n info!(\"Ran {} blob migration(s)\", ran_migrations);\n }\n\n Ok(())\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n\n fn create_test_pool() -> Pool {\n let manager = SqliteConnectionManager::memory();\n let pool = Pool::builder().max_size(1).build(manager).unwrap();\n migrate_blob_db(&pool).unwrap();\n pool\n }\n\n #[test]\n fn test_insert_and_get_chunks() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n let body_id = \"rs_test123.request\";\n let chunk1 = BodyChunk::new(body_id, 0, b\"Hello, \".to_vec());\n let chunk2 = BodyChunk::new(body_id, 1, b\"World!\".to_vec());\n\n ctx.insert_chunk(&chunk1).unwrap();\n ctx.insert_chunk(&chunk2).unwrap();\n\n let chunks = ctx.get_chunks(body_id).unwrap();\n assert_eq!(chunks.len(), 2);\n assert_eq!(chunks[0].chunk_index, 0);\n assert_eq!(chunks[0].data, b\"Hello, \");\n assert_eq!(chunks[1].chunk_index, 1);\n assert_eq!(chunks[1].data, b\"World!\");\n }\n\n #[test]\n fn test_get_chunks_ordered_by_index() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n let body_id = \"rs_test123.request\";\n\n // Insert out of order\n ctx.insert_chunk(&BodyChunk::new(body_id, 2, b\"C\".to_vec())).unwrap();\n ctx.insert_chunk(&BodyChunk::new(body_id, 0, b\"A\".to_vec())).unwrap();\n ctx.insert_chunk(&BodyChunk::new(body_id, 1, b\"B\".to_vec())).unwrap();\n\n let chunks = ctx.get_chunks(body_id).unwrap();\n assert_eq!(chunks.len(), 3);\n assert_eq!(chunks[0].data, b\"A\");\n assert_eq!(chunks[1].data, b\"B\");\n assert_eq!(chunks[2].data, b\"C\");\n }\n\n #[test]\n fn test_delete_chunks() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n let body_id = \"rs_test123.request\";\n ctx.insert_chunk(&BodyChunk::new(body_id, 0, b\"data\".to_vec())).unwrap();\n\n assert!(ctx.body_exists(body_id).unwrap());\n\n ctx.delete_chunks(body_id).unwrap();\n\n assert!(!ctx.body_exists(body_id).unwrap());\n assert_eq!(ctx.get_chunks(body_id).unwrap().len(), 0);\n }\n\n #[test]\n fn test_delete_chunks_like() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n // Insert chunks for same response but different body types\n ctx.insert_chunk(&BodyChunk::new(\"rs_abc.request\", 0, b\"req\".to_vec())).unwrap();\n ctx.insert_chunk(&BodyChunk::new(\"rs_abc.response\", 0, b\"resp\".to_vec())).unwrap();\n ctx.insert_chunk(&BodyChunk::new(\"rs_other.request\", 0, b\"other\".to_vec())).unwrap();\n\n // Delete all bodies for rs_abc\n ctx.delete_chunks_like(\"rs_abc.%\").unwrap();\n\n // rs_abc bodies should be gone\n assert!(!ctx.body_exists(\"rs_abc.request\").unwrap());\n assert!(!ctx.body_exists(\"rs_abc.response\").unwrap());\n\n // rs_other should still exist\n assert!(ctx.body_exists(\"rs_other.request\").unwrap());\n }\n\n #[test]\n fn test_get_body_size() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n let body_id = \"rs_test123.request\";\n ctx.insert_chunk(&BodyChunk::new(body_id, 0, b\"Hello\".to_vec())).unwrap();\n ctx.insert_chunk(&BodyChunk::new(body_id, 1, b\"World\".to_vec())).unwrap();\n\n let size = ctx.get_body_size(body_id).unwrap();\n assert_eq!(size, 10); // \"Hello\" + \"World\" = 10 bytes\n }\n\n #[test]\n fn test_get_body_size_empty() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n let size = ctx.get_body_size(\"nonexistent\").unwrap();\n assert_eq!(size, 0);\n }\n\n #[test]\n fn test_body_exists() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n assert!(!ctx.body_exists(\"rs_test.request\").unwrap());\n\n ctx.insert_chunk(&BodyChunk::new(\"rs_test.request\", 0, b\"data\".to_vec())).unwrap();\n\n assert!(ctx.body_exists(\"rs_test.request\").unwrap());\n }\n\n #[test]\n fn test_multiple_bodies_isolated() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n ctx.insert_chunk(&BodyChunk::new(\"body1\", 0, b\"data1\".to_vec())).unwrap();\n ctx.insert_chunk(&BodyChunk::new(\"body2\", 0, b\"data2\".to_vec())).unwrap();\n\n let chunks1 = ctx.get_chunks(\"body1\").unwrap();\n let chunks2 = ctx.get_chunks(\"body2\").unwrap();\n\n assert_eq!(chunks1.len(), 1);\n assert_eq!(chunks1[0].data, b\"data1\");\n assert_eq!(chunks2.len(), 1);\n assert_eq!(chunks2[0].data, b\"data2\");\n }\n\n #[test]\n fn test_large_chunk() {\n let pool = create_test_pool();\n let manager = BlobManager::new(pool);\n let ctx = manager.connect();\n\n // 1MB chunk\n let large_data: Vec = (0..1024 * 1024).map(|i| (i % 256) as u8).collect();\n let body_id = \"rs_large.request\";\n\n ctx.insert_chunk(&BodyChunk::new(body_id, 0, large_data.clone())).unwrap();\n\n let chunks = ctx.get_chunks(body_id).unwrap();\n assert_eq!(chunks.len(), 1);\n assert_eq!(chunks[0].data, large_data);\n assert_eq!(ctx.get_body_size(body_id).unwrap(), 1024 * 1024);\n }\n}\n" }, { "path": "crates/yaak-models/src/connection_or_tx.rs", "content": "use r2d2::PooledConnection;\nuse r2d2_sqlite::SqliteConnectionManager;\nuse rusqlite::{Connection, Statement, ToSql, Transaction};\n\npub enum ConnectionOrTx<'a> {\n Connection(PooledConnection),\n Transaction(&'a Transaction<'a>),\n}\n\nimpl<'a> ConnectionOrTx<'a> {\n pub(crate) fn resolve(&self) -> &Connection {\n match self {\n ConnectionOrTx::Connection(c) => c,\n ConnectionOrTx::Transaction(c) => c,\n }\n }\n\n pub(crate) fn prepare(&self, sql: &str) -> rusqlite::Result> {\n self.resolve().prepare(sql)\n }\n\n pub(crate) fn execute(&self, sql: &str, params: &[&dyn ToSql]) -> rusqlite::Result {\n self.resolve().execute(sql, params)\n }\n}\n" }, { "path": "crates/yaak-models/src/db_context.rs", "content": "use crate::connection_or_tx::ConnectionOrTx;\nuse crate::error::Error::ModelNotFound;\nuse crate::error::Result;\nuse crate::models::{AnyModel, UpsertModelInfo};\nuse crate::util::{ModelChangeEvent, ModelPayload, UpdateSource};\nuse rusqlite::{OptionalExtension, params};\nuse sea_query::{\n Asterisk, Expr, Func, IntoColumnRef, IntoIden, IntoTableRef, OnConflict, Query, SimpleExpr,\n SqliteQueryBuilder,\n};\nuse sea_query_rusqlite::RusqliteBinder;\nuse std::fmt::Debug;\nuse std::sync::mpsc;\n\npub struct DbContext<'a> {\n pub(crate) _events_tx: mpsc::Sender,\n pub(crate) conn: ConnectionOrTx<'a>,\n}\n\nimpl<'a> DbContext<'a> {\n pub(crate) fn find_one<'s, M>(\n &self,\n col: impl IntoColumnRef + IntoIden + Clone,\n value: impl Into + Debug,\n ) -> Result\n where\n M: Into + Clone + UpsertModelInfo,\n {\n let value_debug = format!(\"{:?}\", value);\n\n let value_expr = value.into();\n let (sql, params) = Query::select()\n .from(M::table_name())\n .column(Asterisk)\n .cond_where(Expr::col(col.clone()).eq(value_expr))\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.prepare(sql.as_str()).expect(\"Failed to prepare query\");\n match stmt.query_row(&*params.as_params(), M::from_row) {\n Ok(result) => Ok(result),\n Err(rusqlite::Error::QueryReturnedNoRows) => Err(ModelNotFound(format!(\n r#\"table \"{}\" {} == {}\"#,\n M::table_name().into_iden().to_string(),\n col.into_iden().to_string(),\n value_debug\n ))),\n Err(e) => Err(crate::error::Error::SqlError(e)),\n }\n }\n\n pub(crate) fn find_optional<'s, M>(\n &self,\n col: impl IntoColumnRef,\n value: impl Into,\n ) -> Option\n where\n M: Into + Clone + UpsertModelInfo,\n {\n let (sql, params) = Query::select()\n .from(M::table_name())\n .column(Asterisk)\n .cond_where(Expr::col(col).eq(value))\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.prepare(sql.as_str()).expect(\"Failed to prepare query\");\n stmt.query_row(&*params.as_params(), M::from_row)\n .optional()\n .expect(\"Failed to run find on DB\")\n }\n\n pub(crate) fn find_all<'s, M>(&self) -> Result>\n where\n M: Into + Clone + UpsertModelInfo,\n {\n let (order_by_col, order_by_dir) = M::order_by();\n let (sql, params) = Query::select()\n .from(M::table_name())\n .column(Asterisk)\n .order_by(order_by_col, order_by_dir)\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.resolve().prepare(sql.as_str())?;\n let items = stmt.query_map(&*params.as_params(), M::from_row)?;\n Ok(items.map(|v| v.unwrap()).collect())\n }\n\n pub(crate) fn find_many<'s, M>(\n &self,\n col: impl IntoColumnRef,\n value: impl Into,\n limit: Option,\n ) -> Result>\n where\n M: Into + Clone + UpsertModelInfo,\n {\n // TODO: Figure out how to do this conditional builder better\n let (order_by_col, order_by_dir) = M::order_by();\n let (sql, params) = if let Some(limit) = limit {\n Query::select()\n .from(M::table_name())\n .column(Asterisk)\n .cond_where(Expr::col(col).eq(value))\n .limit(limit)\n .order_by(order_by_col, order_by_dir)\n .build_rusqlite(SqliteQueryBuilder)\n } else {\n Query::select()\n .from(M::table_name())\n .column(Asterisk)\n .cond_where(Expr::col(col).eq(value))\n .order_by(order_by_col, order_by_dir)\n .build_rusqlite(SqliteQueryBuilder)\n };\n\n let mut stmt = self.conn.resolve().prepare(sql.as_str())?;\n let items = stmt.query_map(&*params.as_params(), M::from_row)?;\n Ok(items.map(|v| v.unwrap()).collect())\n }\n\n pub(crate) fn upsert(&self, model: &M, source: &UpdateSource) -> Result\n where\n M: Into + From + UpsertModelInfo + Clone,\n {\n self.upsert_one(\n M::table_name(),\n M::id_column(),\n model.get_id().as_str(),\n model.clone().insert_values(source)?,\n M::update_columns(),\n source,\n )\n }\n\n fn upsert_one(\n &self,\n table: impl IntoTableRef,\n id_col: impl IntoIden + Eq + Clone,\n id_val: &str,\n other_values: Vec<(impl IntoIden + Eq, impl Into)>,\n update_columns: Vec,\n source: &UpdateSource,\n ) -> Result\n where\n M: Into + From + UpsertModelInfo + Clone,\n {\n let id_iden = id_col.into_iden();\n let mut column_vec = vec![id_iden.clone()];\n let mut value_vec =\n vec![if id_val == \"\" { M::generate_id().into() } else { id_val.into() }];\n\n for (col, val) in other_values {\n value_vec.push(val.into());\n column_vec.push(col.into_iden());\n }\n\n let on_conflict = OnConflict::column(id_iden).update_columns(update_columns).to_owned();\n\n let (sql, params) = Query::insert()\n .into_table(table)\n .columns(column_vec)\n .values_panic(value_vec)\n .on_conflict(on_conflict)\n .returning(Query::returning().exprs(vec![\n Expr::col(Asterisk),\n Expr::expr(Func::cust(\"last_insert_rowid\")),\n Expr::col(\"rowid\"),\n ]))\n .build_rusqlite(SqliteQueryBuilder);\n\n let mut stmt = self.conn.resolve().prepare(sql.as_str())?;\n let (m, created): (M, bool) = stmt.query_row(&*params.as_params(), |row| {\n M::from_row(row).and_then(|m| {\n let rowid: i64 = row.get(\"rowid\")?;\n let last_rowid: i64 = row.get(\"last_insert_rowid()\")?;\n Ok((m, rowid == last_rowid))\n })\n })?;\n\n let payload = ModelPayload {\n model: m.clone().into(),\n update_source: source.clone(),\n change: ModelChangeEvent::Upsert { created },\n };\n\n self.record_model_change(&payload)?;\n let _ = self._events_tx.send(payload);\n\n Ok(m)\n }\n\n pub(crate) fn delete<'s, M>(&self, m: &M, source: &UpdateSource) -> Result\n where\n M: Into + Clone + UpsertModelInfo,\n {\n let (sql, params) = Query::delete()\n .from_table(M::table_name())\n .cond_where(Expr::col(M::id_column().into_iden()).eq(m.get_id()))\n .build_rusqlite(SqliteQueryBuilder);\n self.conn.execute(sql.as_str(), &*params.as_params())?;\n\n let payload = ModelPayload {\n model: m.clone().into(),\n update_source: source.clone(),\n change: ModelChangeEvent::Delete,\n };\n\n self.record_model_change(&payload)?;\n let _ = self._events_tx.send(payload);\n\n Ok(m.clone())\n }\n\n fn record_model_change(&self, payload: &ModelPayload) -> Result<()> {\n let payload_json = serde_json::to_string(payload)?;\n let source_json = serde_json::to_string(&payload.update_source)?;\n let change_json = serde_json::to_string(&payload.change)?;\n\n self.conn.resolve().execute(\n r#\"\n INSERT INTO model_changes (model, model_id, change, update_source, payload)\n VALUES (?1, ?2, ?3, ?4, ?5)\n \"#,\n params![\n payload.model.model(),\n payload.model.id(),\n change_json,\n source_json,\n payload_json,\n ],\n )?;\n\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-models/src/error.rs", "content": "use serde::{Serialize, Serializer};\nuse thiserror::Error;\n\n#[derive(Error, Debug)]\npub enum Error {\n #[error(\"SQL error: {0}\")]\n SqlError(#[from] rusqlite::Error),\n\n #[error(\"SQL Pool error: {0}\")]\n SqlPoolError(#[from] r2d2::Error),\n\n #[error(\"Database error: {0}\")]\n Database(String),\n\n #[error(\"IO error: {0}\")]\n Io(#[from] std::io::Error),\n\n #[error(\"JSON error: {0}\")]\n JsonError(#[from] serde_json::Error),\n\n #[error(\"Model not found: {0}\")]\n ModelNotFound(String),\n\n #[error(\"Model serialization error: {0}\")]\n ModelSerializationError(String),\n\n #[error(\"HTTP error: {0}\")]\n GenericError(String),\n\n #[error(\"DB Migration Failed: {0}\")]\n MigrationError(String),\n\n #[error(\"No base environment for {0}\")]\n MissingBaseEnvironment(String),\n\n #[error(\"Multiple base environments for {0}. Delete duplicates before continuing.\")]\n MultipleBaseEnvironments(String),\n\n #[error(\"unknown error\")]\n Unknown,\n}\n\nimpl Serialize for Error {\n fn serialize(&self, serializer: S) -> std::result::Result\n where\n S: Serializer,\n {\n serializer.serialize_str(self.to_string().as_ref())\n }\n}\n\npub type Result = std::result::Result;\n" }, { "path": "crates/yaak-models/src/lib.rs", "content": "use crate::blob_manager::{BlobManager, migrate_blob_db};\nuse crate::error::{Error, Result};\nuse crate::migrate::migrate_db;\nuse crate::query_manager::QueryManager;\nuse crate::util::ModelPayload;\nuse log::info;\nuse r2d2::Pool;\nuse r2d2_sqlite::SqliteConnectionManager;\nuse std::fs::create_dir_all;\nuse std::path::Path;\nuse std::sync::mpsc;\nuse std::time::Duration;\n\npub mod blob_manager;\nmod connection_or_tx;\npub mod db_context;\npub mod error;\npub mod migrate;\npub mod models;\npub mod queries;\npub mod query_manager;\npub mod render;\npub mod util;\n\n/// Initialize the database managers for standalone (non-Tauri) usage.\n///\n/// Returns a tuple of (QueryManager, BlobManager, event_receiver).\n/// The event_receiver can be used to listen for model change events.\npub fn init_standalone(\n db_path: impl AsRef,\n blob_path: impl AsRef,\n) -> Result<(QueryManager, BlobManager, mpsc::Receiver)> {\n let db_path = db_path.as_ref();\n let blob_path = blob_path.as_ref();\n\n // Create parent directories if needed\n if let Some(parent) = db_path.parent() {\n create_dir_all(parent)?;\n }\n if let Some(parent) = blob_path.parent() {\n create_dir_all(parent)?;\n }\n\n // Main database pool\n info!(\"Initializing app database {db_path:?}\");\n let manager = SqliteConnectionManager::file(db_path);\n let pool = Pool::builder()\n .max_size(100)\n .connection_timeout(Duration::from_secs(10))\n .build(manager)\n .map_err(|e| Error::Database(e.to_string()))?;\n\n migrate_db(&pool)?;\n\n info!(\"Initializing blobs database {blob_path:?}\");\n\n // Blob database pool\n let blob_manager = SqliteConnectionManager::file(blob_path);\n let blob_pool = Pool::builder()\n .max_size(50)\n .connection_timeout(Duration::from_secs(10))\n .build(blob_manager)\n .map_err(|e| Error::Database(e.to_string()))?;\n\n migrate_blob_db(&blob_pool)?;\n\n let (tx, rx) = mpsc::channel();\n let query_manager = QueryManager::new(pool, tx);\n let blob_manager = BlobManager::new(blob_pool);\n\n Ok((query_manager, blob_manager, rx))\n}\n\n/// Initialize the database managers with in-memory SQLite databases.\n/// Useful for testing and CI environments.\npub fn init_in_memory() -> Result<(QueryManager, BlobManager, mpsc::Receiver)> {\n // Main database pool\n let manager = SqliteConnectionManager::memory();\n let pool = Pool::builder()\n .max_size(1) // In-memory DB doesn't support multiple connections\n .build(manager)\n .map_err(|e| Error::Database(e.to_string()))?;\n\n migrate_db(&pool)?;\n\n // Blob database pool\n let blob_manager = SqliteConnectionManager::memory();\n let blob_pool = Pool::builder()\n .max_size(1)\n .build(blob_manager)\n .map_err(|e| Error::Database(e.to_string()))?;\n\n migrate_blob_db(&blob_pool)?;\n\n let (tx, rx) = mpsc::channel();\n let query_manager = QueryManager::new(pool, tx);\n let blob_manager = BlobManager::new(blob_pool);\n\n Ok((query_manager, blob_manager, rx))\n}\n" }, { "path": "crates/yaak-models/src/migrate.rs", "content": "use crate::error::Error::MigrationError;\nuse crate::error::Result;\nuse include_dir::{Dir, DirEntry, include_dir};\nuse log::{debug, info};\nuse r2d2::Pool;\nuse r2d2_sqlite::SqliteConnectionManager;\nuse rusqlite::{OptionalExtension, TransactionBehavior, params};\nuse sha2::{Digest, Sha384};\n\nstatic MIGRATIONS_DIR: Dir = include_dir!(\"$CARGO_MANIFEST_DIR/migrations\");\n\npub fn migrate_db(pool: &Pool) -> Result<()> {\n info!(\"Running database migrations\");\n\n // Ensure the table exists\n // NOTE: Yaak used to use sqlx for migrations, so we need to mirror that table structure. We\n // are writing checksum but not verifying because we want to be able to change migrations after\n // a release in case something breaks.\n pool.get()?.execute(\n \"CREATE TABLE IF NOT EXISTS _sqlx_migrations (\n version BIGINT PRIMARY KEY,\n description TEXT NOT NULL,\n installed_on TIMESTAMP default CURRENT_TIMESTAMP NOT NULL,\n success BOOLEAN NOT NULL,\n checksum BLOB NOT NULL,\n execution_time BIGINT NOT NULL\n )\",\n [],\n )?;\n\n // Read and sort all .sql files\n let mut entries = MIGRATIONS_DIR\n .entries()\n .into_iter()\n .filter(|e| e.path().extension().map(|ext| ext == \"sql\").unwrap_or(false))\n .collect::>();\n\n // Ensure they're in the correct order\n entries.sort_by_key(|e| e.path());\n\n // Run each migration in a transaction\n let mut num_migrations = 0;\n let mut ran_migrations = 0;\n for entry in entries {\n num_migrations += 1;\n let mut conn = pool.get()?;\n let mut tx = conn.transaction_with_behavior(TransactionBehavior::Immediate)?;\n match run_migration(entry, &mut tx) {\n Ok(ran) => {\n if ran {\n ran_migrations += 1;\n }\n tx.commit()?\n }\n Err(e) => {\n let msg = format!(\n \"{} failed with {}\",\n entry.path().file_name().unwrap().to_str().unwrap(),\n e.to_string()\n );\n tx.rollback()?;\n return Err(MigrationError(msg));\n }\n };\n }\n\n if ran_migrations == 0 {\n info!(\"No migrations to run out of {}\", num_migrations);\n } else {\n info!(\"Ran {}/{} migrations\", ran_migrations, num_migrations);\n }\n\n Ok(())\n}\n\nfn run_migration(migration_path: &DirEntry, tx: &mut rusqlite::Transaction) -> Result {\n let start = std::time::Instant::now();\n let (version, description) = split_migration_filename(migration_path.path().to_str().unwrap())\n .expect(\"Failed to parse migration filename\");\n\n // Skip if already applied\n let row: Option = tx\n .query_row(\"SELECT 1 FROM _sqlx_migrations WHERE version = ?\", [version.clone()], |r| {\n r.get(0)\n })\n .optional()?;\n\n if row.is_some() {\n debug!(\"Skipping already run migration {description}\");\n return Ok(false); // Migration was already run\n }\n\n let sql =\n migration_path.as_file().unwrap().contents_utf8().expect(\"Failed to read migration file\");\n info!(\"Applying migration {description}\");\n\n // Split on `;`? β†’ optional depending on how your SQL is structured\n tx.execute_batch(&sql)?;\n\n let execution_time = start.elapsed().as_nanos() as i64;\n let checksum = sha384_hex_prefixed(sql.as_bytes());\n\n // NOTE: The success column is never used. It's just there for sqlx compatibility.\n tx.execute(\n \"INSERT INTO _sqlx_migrations (version, description, execution_time, checksum, success) VALUES (?, ?, ?, ?, ?)\",\n params![version, description, execution_time, checksum, true],\n )?;\n\n Ok(true)\n}\n\nfn split_migration_filename(filename: &str) -> Option<(String, String)> {\n // Remove the .sql extension\n let trimmed = filename.strip_suffix(\".sql\")?;\n\n // Split on the first underscore\n let mut parts = trimmed.splitn(2, '_');\n let version = parts.next()?.to_string();\n let description = parts.next()?.to_string();\n\n Some((version, description))\n}\n\nfn sha384_hex_prefixed(input: &[u8]) -> String {\n let mut hasher = Sha384::new();\n hasher.update(input);\n let result = hasher.finalize();\n\n // Format as 0x... with uppercase hex\n format!(\"0x{}\", hex::encode_upper(result))\n}\n" }, { "path": "crates/yaak-models/src/models.rs", "content": "use crate::error::Result;\nuse crate::models::HttpRequestIden::{\n Authentication, AuthenticationType, Body, BodyType, CreatedAt, Description, FolderId, Headers,\n Method, Name, SortPriority, UpdatedAt, Url, UrlParameters, WorkspaceId,\n};\nuse crate::util::{UpdateSource, generate_prefixed_id};\nuse chrono::{NaiveDateTime, Utc};\nuse rusqlite::Row;\nuse schemars::JsonSchema;\nuse sea_query::Order::Desc;\nuse sea_query::{IntoColumnRef, IntoIden, IntoTableRef, Order, SimpleExpr, enum_def};\nuse serde::{Deserialize, Deserializer, Serialize};\nuse serde_json::Value;\nuse std::collections::BTreeMap;\nuse std::collections::HashMap;\nuse std::fmt::{Debug, Display};\nuse std::str::FromStr;\nuse ts_rs::TS;\n\n#[macro_export]\nmacro_rules! impl_model {\n ($t:ty, $variant:ident) => {\n impl $crate::Model for $t {\n fn into_any(self) -> $crate::AnyModel {\n $crate::AnyModel::$variant(self)\n }\n }\n };\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"camelCase\", tag = \"type\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum ProxySetting {\n Enabled {\n http: String,\n https: String,\n auth: Option,\n\n // These were added later, so give them defaults\n #[serde(default)]\n bypass: String,\n #[serde(default)]\n disabled: bool,\n },\n Disabled,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct ProxySettingAuth {\n pub user: String,\n pub password: String,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct ClientCertificate {\n pub host: String,\n #[serde(default)]\n pub port: Option,\n #[serde(default)]\n pub crt_file: Option,\n #[serde(default)]\n pub key_file: Option,\n #[serde(default)]\n pub pfx_file: Option,\n #[serde(default)]\n pub passphrase: Option,\n #[serde(default = \"default_true\")]\n #[ts(optional, as = \"Option\")]\n pub enabled: bool,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct DnsOverride {\n pub hostname: String,\n #[serde(default)]\n pub ipv4: Vec,\n #[serde(default)]\n pub ipv6: Vec,\n #[serde(default = \"default_true\")]\n #[ts(optional, as = \"Option\")]\n pub enabled: bool,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum EditorKeymap {\n Default,\n Vim,\n Vscode,\n Emacs,\n}\n\nimpl FromStr for EditorKeymap {\n type Err = crate::error::Error;\n\n fn from_str(s: &str) -> Result {\n match s {\n \"default\" => Ok(Self::Default),\n \"vscode\" => Ok(Self::Vscode),\n \"vim\" => Ok(Self::Vim),\n \"emacs\" => Ok(Self::Emacs),\n _ => Ok(Self::default()),\n }\n }\n}\n\nimpl Display for EditorKeymap {\n fn fmt(&self, f: &mut std::fmt::Formatter<'_>) -> std::fmt::Result {\n let str = match self {\n EditorKeymap::Default => \"default\".to_string(),\n EditorKeymap::Vscode => \"vscode\".to_string(),\n EditorKeymap::Vim => \"vim\".to_string(),\n EditorKeymap::Emacs => \"emacs\".to_string(),\n };\n write!(f, \"{}\", str)\n }\n}\n\nimpl Default for EditorKeymap {\n fn default() -> Self {\n Self::Default\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"settings\")]\npub struct Settings {\n #[ts(type = \"\\\"settings\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n\n pub appearance: String,\n pub client_certificates: Vec,\n pub colored_methods: bool,\n pub editor_font: Option,\n pub editor_font_size: i32,\n pub editor_keymap: EditorKeymap,\n pub editor_soft_wrap: bool,\n pub hide_window_controls: bool,\n // When true (primarily on Windows/Linux), use the native OS window title bar and controls\n pub use_native_titlebar: bool,\n pub interface_font: Option,\n pub interface_font_size: i32,\n pub interface_scale: f32,\n pub open_workspace_new_window: Option,\n pub proxy: Option,\n pub theme_dark: String,\n pub theme_light: String,\n pub update_channel: String,\n pub hide_license_badge: bool,\n pub autoupdate: bool,\n pub auto_download_updates: bool,\n pub check_notifications: bool,\n pub hotkeys: HashMap>,\n}\n\nimpl UpsertModelInfo for Settings {\n fn table_name() -> impl IntoTableRef + IntoIden {\n SettingsIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n SettingsIden::Id\n }\n\n fn generate_id() -> String {\n panic!(\"Settings does not have unique IDs\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (SettingsIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use SettingsIden::*;\n let proxy = match self.proxy {\n None => None,\n Some(p) => Some(serde_json::to_string(&p)?),\n };\n let client_certificates = serde_json::to_string(&self.client_certificates)?;\n let hotkeys = serde_json::to_string(&self.hotkeys)?;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (Appearance, self.appearance.as_str().into()),\n (ClientCertificates, client_certificates.into()),\n (EditorFontSize, self.editor_font_size.into()),\n (EditorKeymap, self.editor_keymap.to_string().into()),\n (EditorSoftWrap, self.editor_soft_wrap.into()),\n (EditorFont, self.editor_font.into()),\n (InterfaceFont, self.interface_font.into()),\n (InterfaceFontSize, self.interface_font_size.into()),\n (InterfaceScale, self.interface_scale.into()),\n (HideWindowControls, self.hide_window_controls.into()),\n (UseNativeTitlebar, self.use_native_titlebar.into()),\n (OpenWorkspaceNewWindow, self.open_workspace_new_window.into()),\n (ThemeDark, self.theme_dark.as_str().into()),\n (ThemeLight, self.theme_light.as_str().into()),\n (UpdateChannel, self.update_channel.into()),\n (HideLicenseBadge, self.hide_license_badge.into()),\n (Autoupdate, self.autoupdate.into()),\n (AutoDownloadUpdates, self.auto_download_updates.into()),\n (ColoredMethods, self.colored_methods.into()),\n (CheckNotifications, self.check_notifications.into()),\n (Proxy, proxy.into()),\n (Hotkeys, hotkeys.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n SettingsIden::UpdatedAt,\n SettingsIden::Appearance,\n SettingsIden::ClientCertificates,\n SettingsIden::EditorFontSize,\n SettingsIden::EditorKeymap,\n SettingsIden::EditorSoftWrap,\n SettingsIden::EditorFont,\n SettingsIden::InterfaceFontSize,\n SettingsIden::InterfaceScale,\n SettingsIden::InterfaceFont,\n SettingsIden::HideWindowControls,\n SettingsIden::UseNativeTitlebar,\n SettingsIden::OpenWorkspaceNewWindow,\n SettingsIden::Proxy,\n SettingsIden::ThemeDark,\n SettingsIden::ThemeLight,\n SettingsIden::UpdateChannel,\n SettingsIden::HideLicenseBadge,\n SettingsIden::Autoupdate,\n SettingsIden::AutoDownloadUpdates,\n SettingsIden::ColoredMethods,\n SettingsIden::CheckNotifications,\n SettingsIden::Hotkeys,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let proxy: Option = row.get(\"proxy\")?;\n let client_certificates: String = row.get(\"client_certificates\")?;\n let editor_keymap: String = row.get(\"editor_keymap\")?;\n let hotkeys: String = row.get(\"hotkeys\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n appearance: row.get(\"appearance\")?,\n client_certificates: serde_json::from_str(&client_certificates).unwrap_or_default(),\n editor_font_size: row.get(\"editor_font_size\")?,\n editor_font: row.get(\"editor_font\")?,\n editor_keymap: EditorKeymap::from_str(editor_keymap.as_str()).unwrap(),\n editor_soft_wrap: row.get(\"editor_soft_wrap\")?,\n interface_font_size: row.get(\"interface_font_size\")?,\n interface_scale: row.get(\"interface_scale\")?,\n interface_font: row.get(\"interface_font\")?,\n use_native_titlebar: row.get(\"use_native_titlebar\")?,\n open_workspace_new_window: row.get(\"open_workspace_new_window\")?,\n proxy: proxy.map(|p| -> ProxySetting { serde_json::from_str(p.as_str()).unwrap() }),\n theme_dark: row.get(\"theme_dark\")?,\n theme_light: row.get(\"theme_light\")?,\n hide_window_controls: row.get(\"hide_window_controls\")?,\n update_channel: row.get(\"update_channel\")?,\n autoupdate: row.get(\"autoupdate\")?,\n auto_download_updates: row.get(\"auto_download_updates\")?,\n hide_license_badge: row.get(\"hide_license_badge\")?,\n colored_methods: row.get(\"colored_methods\")?,\n check_notifications: row.get(\"check_notifications\")?,\n hotkeys: serde_json::from_str(&hotkeys).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"workspaces\")]\npub struct Workspace {\n #[ts(type = \"\\\"workspace\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n\n #[ts(type = \"Record\")]\n pub authentication: BTreeMap,\n pub authentication_type: Option,\n pub description: String,\n pub headers: Vec,\n pub name: String,\n pub encryption_key_challenge: Option,\n\n // Settings\n #[serde(default = \"default_true\")]\n pub setting_validate_certificates: bool,\n #[serde(default = \"default_true\")]\n pub setting_follow_redirects: bool,\n pub setting_request_timeout: i32,\n #[serde(default)]\n pub setting_dns_overrides: Vec,\n}\n\nimpl UpsertModelInfo for Workspace {\n fn table_name() -> impl IntoTableRef + IntoIden {\n WorkspaceIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n WorkspaceIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"wk\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (WorkspaceIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use WorkspaceIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (Name, self.name.trim().into()),\n (Authentication, serde_json::to_string(&self.authentication)?.into()),\n (AuthenticationType, self.authentication_type.into()),\n (Headers, serde_json::to_string(&self.headers)?.into()),\n (Description, self.description.into()),\n (EncryptionKeyChallenge, self.encryption_key_challenge.into()),\n (SettingFollowRedirects, self.setting_follow_redirects.into()),\n (SettingRequestTimeout, self.setting_request_timeout.into()),\n (SettingValidateCertificates, self.setting_validate_certificates.into()),\n (SettingDnsOverrides, serde_json::to_string(&self.setting_dns_overrides)?.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n WorkspaceIden::UpdatedAt,\n WorkspaceIden::Name,\n WorkspaceIden::Authentication,\n WorkspaceIden::AuthenticationType,\n WorkspaceIden::Headers,\n WorkspaceIden::Description,\n WorkspaceIden::EncryptionKeyChallenge,\n WorkspaceIden::SettingRequestTimeout,\n WorkspaceIden::SettingFollowRedirects,\n WorkspaceIden::SettingRequestTimeout,\n WorkspaceIden::SettingValidateCertificates,\n WorkspaceIden::SettingDnsOverrides,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let headers: String = row.get(\"headers\")?;\n let authentication: String = row.get(\"authentication\")?;\n let setting_dns_overrides: String = row.get(\"setting_dns_overrides\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n name: row.get(\"name\")?,\n description: row.get(\"description\")?,\n encryption_key_challenge: row.get(\"encryption_key_challenge\")?,\n headers: serde_json::from_str(&headers).unwrap_or_default(),\n authentication: serde_json::from_str(&authentication).unwrap_or_default(),\n authentication_type: row.get(\"authentication_type\")?,\n setting_follow_redirects: row.get(\"setting_follow_redirects\")?,\n setting_request_timeout: row.get(\"setting_request_timeout\")?,\n setting_validate_certificates: row.get(\"setting_validate_certificates\")?,\n setting_dns_overrides: serde_json::from_str(&setting_dns_overrides).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct EncryptedKey {\n pub encrypted_key: String,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"workspace_metas\")]\npub struct WorkspaceMeta {\n #[ts(type = \"\\\"workspace_meta\\\"\")]\n pub model: String,\n pub id: String,\n pub workspace_id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub encryption_key: Option,\n pub setting_sync_dir: Option,\n}\n\nimpl UpsertModelInfo for WorkspaceMeta {\n fn table_name() -> impl IntoTableRef + IntoIden {\n WorkspaceMetaIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n WorkspaceMetaIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"wm\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (WorkspaceMetaIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use WorkspaceMetaIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (EncryptionKey, self.encryption_key.map(|e| serde_json::to_string(&e).unwrap()).into()),\n (SettingSyncDir, self.setting_sync_dir.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n WorkspaceMetaIden::UpdatedAt,\n WorkspaceMetaIden::EncryptionKey,\n WorkspaceMetaIden::SettingSyncDir,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let encryption_key: Option = row.get(\"encryption_key\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n workspace_id: row.get(\"workspace_id\")?,\n model: row.get(\"model\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n encryption_key: encryption_key.map(|e| serde_json::from_str(&e).unwrap()),\n setting_sync_dir: row.get(\"setting_sync_dir\")?,\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum CookieDomain {\n HostOnly(String),\n Suffix(String),\n NotPresent,\n Empty,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum CookieExpires {\n AtUtc(String),\n SessionEnd,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct Cookie {\n pub raw_cookie: String,\n pub domain: CookieDomain,\n pub expires: CookieExpires,\n pub path: (String, bool),\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"cookie_jars\")]\npub struct CookieJar {\n #[ts(type = \"\\\"cookie_jar\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n\n pub cookies: Vec,\n pub name: String,\n}\n\nimpl UpsertModelInfo for CookieJar {\n fn table_name() -> impl IntoTableRef + IntoIden {\n CookieJarIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n CookieJarIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"cj\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (CookieJarIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use CookieJarIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (Name, self.name.trim().into()),\n (Cookies, serde_json::to_string(&self.cookies)?.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n CookieJarIden::UpdatedAt,\n CookieJarIden::Name,\n CookieJarIden::Cookies,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let cookies: String = row.get(\"cookies\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n name: row.get(\"name\")?,\n cookies: serde_json::from_str(cookies.as_str()).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"environments\")]\npub struct Environment {\n #[ts(type = \"\\\"environment\\\"\")]\n pub model: String,\n pub id: String,\n pub workspace_id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n\n pub name: String,\n pub public: bool,\n #[deprecated(\n note = \"parent_model is used instead. This field will be removed when schema field is added for sync/export.\"\n )]\n #[ts(skip)]\n pub base: bool,\n pub parent_model: String,\n pub parent_id: Option,\n /// Variables defined in this environment scope.\n /// Child environments override parent variables by name.\n pub variables: Vec,\n pub color: Option,\n pub sort_priority: f64,\n}\n\nimpl UpsertModelInfo for Environment {\n fn table_name() -> impl IntoTableRef + IntoIden {\n EnvironmentIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n EnvironmentIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"ev\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (EnvironmentIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use EnvironmentIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (ParentId, self.parent_id.into()),\n (ParentModel, self.parent_model.into()),\n (Color, self.color.into()),\n (Name, self.name.trim().into()),\n (Public, self.public.into()),\n (SortPriority, self.sort_priority.into()),\n (Variables, serde_json::to_string(&self.variables)?.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n EnvironmentIden::UpdatedAt,\n EnvironmentIden::ParentId,\n EnvironmentIden::ParentModel,\n EnvironmentIden::Color,\n EnvironmentIden::Name,\n EnvironmentIden::Public,\n EnvironmentIden::Variables,\n EnvironmentIden::SortPriority,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let variables: String = row.get(\"variables\")?;\n let parent_model = row.get(\"parent_model\")?;\n let base = parent_model == \"workspace\";\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n parent_id: row.get(\"parent_id\")?,\n parent_model,\n color: row.get(\"color\")?,\n name: row.get(\"name\")?,\n public: row.get(\"public\")?,\n variables: serde_json::from_str(variables.as_str()).unwrap_or_default(),\n sort_priority: row.get(\"sort_priority\")?,\n\n // Deprecated field, but we need to keep it around for a couple of versions\n // for compatibility because sync/export don't have a schema field\n #[allow(deprecated)]\n base,\n })\n }\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct EnvironmentVariable {\n #[serde(default = \"default_true\")]\n #[ts(optional, as = \"Option\")]\n pub enabled: bool,\n pub name: String,\n pub value: String,\n #[ts(optional, as = \"Option\")]\n pub id: Option,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct ParentAuthentication {\n #[ts(type = \"Record\")]\n pub authentication: BTreeMap,\n pub authentication_type: Option,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct ParentHeaders {\n pub headers: Vec,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"folders\")]\npub struct Folder {\n #[ts(type = \"\\\"folder\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub folder_id: Option,\n\n #[ts(type = \"Record\")]\n pub authentication: BTreeMap,\n pub authentication_type: Option,\n pub description: String,\n pub headers: Vec,\n pub name: String,\n pub sort_priority: f64,\n}\n\nimpl UpsertModelInfo for Folder {\n fn table_name() -> impl IntoTableRef + IntoIden {\n FolderIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n FolderIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"fl\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (FolderIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use FolderIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (FolderId, self.folder_id.into()),\n (Authentication, serde_json::to_string(&self.authentication)?.into()),\n (AuthenticationType, self.authentication_type.into()),\n (Headers, serde_json::to_string(&self.headers)?.into()),\n (Description, self.description.into()),\n (Name, self.name.trim().into()),\n (SortPriority, self.sort_priority.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n FolderIden::UpdatedAt,\n FolderIden::Name,\n FolderIden::Authentication,\n FolderIden::AuthenticationType,\n FolderIden::Headers,\n FolderIden::Description,\n FolderIden::FolderId,\n FolderIden::SortPriority,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let headers: String = row.get(\"headers\")?;\n let authentication: String = row.get(\"authentication\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n sort_priority: row.get(\"sort_priority\")?,\n workspace_id: row.get(\"workspace_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n folder_id: row.get(\"folder_id\")?,\n name: row.get(\"name\")?,\n description: row.get(\"description\")?,\n headers: serde_json::from_str(&headers).unwrap_or_default(),\n authentication_type: row.get(\"authentication_type\")?,\n authentication: serde_json::from_str(&authentication).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct HttpRequestHeader {\n #[serde(default = \"default_true\")]\n #[ts(optional, as = \"Option\")]\n pub enabled: bool,\n pub name: String,\n pub value: String,\n #[ts(optional, as = \"Option\")]\n pub id: Option,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct HttpUrlParameter {\n #[serde(default = \"default_true\")]\n #[ts(optional, as = \"Option\")]\n pub enabled: bool,\n /// Colon-prefixed parameters are treated as path parameters if they match, like `/users/:id`\n /// Other entries are appended as query parameters\n pub name: String,\n pub value: String,\n #[ts(optional, as = \"Option\")]\n pub id: Option,\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"http_requests\")]\npub struct HttpRequest {\n #[ts(type = \"\\\"http_request\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub folder_id: Option,\n\n #[ts(type = \"Record\")]\n pub authentication: BTreeMap,\n pub authentication_type: Option,\n #[ts(type = \"Record\")]\n pub body: BTreeMap,\n pub body_type: Option,\n pub description: String,\n pub headers: Vec,\n #[serde(default = \"default_http_method\")]\n pub method: String,\n pub name: String,\n pub sort_priority: f64,\n pub url: String,\n /// URL parameters used for both path placeholders (`:id`) and query string entries.\n pub url_parameters: Vec,\n}\n\nimpl UpsertModelInfo for HttpRequest {\n fn table_name() -> impl IntoTableRef + IntoIden {\n HttpRequestIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n HttpRequestIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"rq\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (HttpResponseIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.to_string()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (FolderId, self.folder_id.into()),\n (Name, self.name.trim().into()),\n (Description, self.description.into()),\n (Url, self.url.into()),\n (UrlParameters, serde_json::to_string(&self.url_parameters)?.into()),\n (Method, self.method.into()),\n (Body, serde_json::to_string(&self.body)?.into()),\n (BodyType, self.body_type.into()),\n (Authentication, serde_json::to_string(&self.authentication)?.into()),\n (AuthenticationType, self.authentication_type.into()),\n (Headers, serde_json::to_string(&self.headers)?.into()),\n (SortPriority, self.sort_priority.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n UpdatedAt,\n WorkspaceId,\n Name,\n Description,\n FolderId,\n Method,\n Headers,\n Body,\n BodyType,\n Authentication,\n AuthenticationType,\n Url,\n UrlParameters,\n SortPriority,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result {\n let url_parameters: String = row.get(\"url_parameters\")?;\n let body: String = row.get(\"body\")?;\n let authentication: String = row.get(\"authentication\")?;\n let headers: String = row.get(\"headers\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n authentication: serde_json::from_str(authentication.as_str()).unwrap_or_default(),\n authentication_type: row.get(\"authentication_type\")?,\n body: serde_json::from_str(body.as_str()).unwrap_or_default(),\n body_type: row.get(\"body_type\")?,\n description: row.get(\"description\")?,\n folder_id: row.get(\"folder_id\")?,\n headers: serde_json::from_str(headers.as_str()).unwrap_or_default(),\n method: row.get(\"method\")?,\n name: row.get(\"name\")?,\n sort_priority: row.get(\"sort_priority\")?,\n url: row.get(\"url\")?,\n url_parameters: serde_json::from_str(url_parameters.as_str()).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum WebsocketConnectionState {\n Initialized,\n Connected,\n Closing,\n Closed,\n}\n\nimpl Default for WebsocketConnectionState {\n fn default() -> Self {\n Self::Initialized\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"websocket_connections\")]\npub struct WebsocketConnection {\n #[ts(type = \"\\\"websocket_connection\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub request_id: String,\n\n pub elapsed: i32,\n pub error: Option,\n pub headers: Vec,\n pub state: WebsocketConnectionState,\n pub status: i32,\n pub url: String,\n}\n\nimpl UpsertModelInfo for WebsocketConnection {\n fn table_name() -> impl IntoTableRef + IntoIden {\n WebsocketConnectionIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n WebsocketConnectionIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"wc\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (WebsocketConnectionIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use WebsocketConnectionIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (RequestId, self.request_id.into()),\n (Elapsed, self.elapsed.into()),\n (Error, self.error.into()),\n (Headers, serde_json::to_string(&self.headers)?.into()),\n (State, serde_json::to_value(&self.state)?.as_str().into()),\n (Status, self.status.into()),\n (Url, self.url.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n WebsocketConnectionIden::UpdatedAt,\n WebsocketConnectionIden::Elapsed,\n WebsocketConnectionIden::Error,\n WebsocketConnectionIden::Headers,\n WebsocketConnectionIden::State,\n WebsocketConnectionIden::Status,\n WebsocketConnectionIden::Url,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let headers: String = row.get(\"headers\")?;\n let state: String = row.get(\"state\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n request_id: row.get(\"request_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n url: row.get(\"url\")?,\n headers: serde_json::from_str(headers.as_str()).unwrap_or_default(),\n elapsed: row.get(\"elapsed\")?,\n error: row.get(\"error\")?,\n state: serde_json::from_str(format!(r#\"\"{state}\"\"#).as_str()).unwrap(),\n status: row.get(\"status\")?,\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Eq, PartialEq, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum WebsocketMessageType {\n Text,\n Binary,\n}\n\nimpl Default for WebsocketMessageType {\n fn default() -> Self {\n Self::Text\n }\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"websocket_requests\")]\npub struct WebsocketRequest {\n #[ts(type = \"\\\"websocket_request\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub folder_id: Option,\n\n #[ts(type = \"Record\")]\n pub authentication: BTreeMap,\n pub authentication_type: Option,\n pub description: String,\n pub headers: Vec,\n pub message: String,\n pub name: String,\n pub sort_priority: f64,\n pub url: String,\n /// URL parameters used for both path placeholders (`:id`) and query string entries.\n pub url_parameters: Vec,\n}\n\nimpl UpsertModelInfo for WebsocketRequest {\n fn table_name() -> impl IntoTableRef + IntoIden {\n WebsocketRequestIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n WebsocketRequestIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"wr\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (WebsocketRequestIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use WebsocketRequestIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (FolderId, self.folder_id.as_ref().map(|s| s.as_str()).into()),\n (Authentication, serde_json::to_string(&self.authentication)?.into()),\n (AuthenticationType, self.authentication_type.into()),\n (Description, self.description.into()),\n (Headers, serde_json::to_string(&self.headers)?.into()),\n (Message, self.message.into()),\n (Name, self.name.trim().into()),\n (SortPriority, self.sort_priority.into()),\n (Url, self.url.into()),\n (UrlParameters, serde_json::to_string(&self.url_parameters)?.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n WebsocketRequestIden::UpdatedAt,\n WebsocketRequestIden::WorkspaceId,\n WebsocketRequestIden::FolderId,\n WebsocketRequestIden::Authentication,\n WebsocketRequestIden::AuthenticationType,\n WebsocketRequestIden::Description,\n WebsocketRequestIden::Headers,\n WebsocketRequestIden::Message,\n WebsocketRequestIden::Name,\n WebsocketRequestIden::SortPriority,\n WebsocketRequestIden::Url,\n WebsocketRequestIden::UrlParameters,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let url_parameters: String = row.get(\"url_parameters\")?;\n let authentication: String = row.get(\"authentication\")?;\n let headers: String = row.get(\"headers\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n sort_priority: row.get(\"sort_priority\")?,\n workspace_id: row.get(\"workspace_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n url: row.get(\"url\")?,\n url_parameters: serde_json::from_str(url_parameters.as_str()).unwrap_or_default(),\n message: row.get(\"message\")?,\n description: row.get(\"description\")?,\n authentication: serde_json::from_str(authentication.as_str()).unwrap_or_default(),\n authentication_type: row.get(\"authentication_type\")?,\n headers: serde_json::from_str(headers.as_str()).unwrap_or_default(),\n folder_id: row.get(\"folder_id\")?,\n name: row.get(\"name\")?,\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Eq, PartialEq, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum WebsocketEventType {\n Binary,\n Close,\n Frame,\n Open,\n Ping,\n Pong,\n Text,\n}\n\nimpl Default for WebsocketEventType {\n fn default() -> Self {\n Self::Text\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"websocket_events\")]\npub struct WebsocketEvent {\n #[ts(type = \"\\\"websocket_event\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub request_id: String,\n pub connection_id: String,\n pub is_server: bool,\n\n pub message: Vec,\n pub message_type: WebsocketEventType,\n}\n\nimpl UpsertModelInfo for WebsocketEvent {\n fn table_name() -> impl IntoTableRef + IntoIden {\n WebsocketEventIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n WebsocketEventIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"we\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (WebsocketEventIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use WebsocketEventIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (ConnectionId, self.connection_id.into()),\n (RequestId, self.request_id.into()),\n (MessageType, serde_json::to_string(&self.message_type)?.into()),\n (IsServer, self.is_server.into()),\n (Message, self.message.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n WebsocketEventIden::UpdatedAt,\n WebsocketEventIden::MessageType,\n WebsocketEventIden::IsServer,\n WebsocketEventIden::Message,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let message_type: String = row.get(\"message_type\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n request_id: row.get(\"request_id\")?,\n connection_id: row.get(\"connection_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n message: row.get(\"message\")?,\n is_server: row.get(\"is_server\")?,\n message_type: serde_json::from_str(message_type.as_str()).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct HttpResponseHeader {\n pub name: String,\n pub value: String,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum HttpResponseState {\n Initialized,\n Connected,\n Closed,\n}\n\nimpl Default for HttpResponseState {\n fn default() -> Self {\n Self::Initialized\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"http_responses\")]\npub struct HttpResponse {\n #[ts(type = \"\\\"http_response\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub request_id: String,\n\n pub body_path: Option,\n pub content_length: Option,\n pub content_length_compressed: Option,\n pub elapsed: i32,\n pub elapsed_headers: i32,\n pub elapsed_dns: i32,\n pub error: Option,\n pub headers: Vec,\n pub remote_addr: Option,\n pub request_content_length: Option,\n pub request_headers: Vec,\n pub status: i32,\n pub status_reason: Option,\n pub state: HttpResponseState,\n pub url: String,\n pub version: Option,\n}\n\nimpl UpsertModelInfo for HttpResponse {\n fn table_name() -> impl IntoTableRef + IntoIden {\n HttpResponseIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n HttpResponseIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"rs\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (HttpResponseIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use HttpResponseIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (RequestId, self.request_id.into()),\n (WorkspaceId, self.workspace_id.into()),\n (BodyPath, self.body_path.into()),\n (ContentLength, self.content_length.into()),\n (ContentLengthCompressed, self.content_length_compressed.into()),\n (Elapsed, self.elapsed.into()),\n (ElapsedHeaders, self.elapsed_headers.into()),\n (ElapsedDns, self.elapsed_dns.into()),\n (Error, self.error.into()),\n (Headers, serde_json::to_string(&self.headers)?.into()),\n (RemoteAddr, self.remote_addr.into()),\n (RequestHeaders, serde_json::to_string(&self.request_headers)?.into()),\n (State, serde_json::to_value(self.state)?.as_str().into()),\n (Status, self.status.into()),\n (StatusReason, self.status_reason.into()),\n (Url, self.url.into()),\n (Version, self.version.into()),\n (RequestContentLength, self.request_content_length.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n HttpResponseIden::UpdatedAt,\n HttpResponseIden::BodyPath,\n HttpResponseIden::ContentLength,\n HttpResponseIden::ContentLengthCompressed,\n HttpResponseIden::Elapsed,\n HttpResponseIden::ElapsedHeaders,\n HttpResponseIden::ElapsedDns,\n HttpResponseIden::Error,\n HttpResponseIden::Headers,\n HttpResponseIden::RemoteAddr,\n HttpResponseIden::RequestContentLength,\n HttpResponseIden::RequestHeaders,\n HttpResponseIden::State,\n HttpResponseIden::Status,\n HttpResponseIden::StatusReason,\n HttpResponseIden::Url,\n HttpResponseIden::Version,\n ]\n }\n\n fn from_row(r: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let headers: String = r.get(\"headers\")?;\n let state: String = r.get(\"state\")?;\n Ok(Self {\n id: r.get(\"id\")?,\n model: r.get(\"model\")?,\n workspace_id: r.get(\"workspace_id\")?,\n request_id: r.get(\"request_id\")?,\n created_at: r.get(\"created_at\")?,\n updated_at: r.get(\"updated_at\")?,\n error: r.get(\"error\")?,\n url: r.get(\"url\")?,\n content_length: r.get(\"content_length\")?,\n content_length_compressed: r.get(\"content_length_compressed\").unwrap_or_default(),\n version: r.get(\"version\")?,\n elapsed: r.get(\"elapsed\")?,\n elapsed_headers: r.get(\"elapsed_headers\")?,\n elapsed_dns: r.get(\"elapsed_dns\").unwrap_or_default(),\n remote_addr: r.get(\"remote_addr\")?,\n status: r.get(\"status\")?,\n status_reason: r.get(\"status_reason\")?,\n state: serde_json::from_str(format!(r#\"\"{state}\"\"#).as_str()).unwrap(),\n body_path: r.get(\"body_path\")?,\n headers: serde_json::from_str(headers.as_str()).unwrap_or_default(),\n request_content_length: r.get(\"request_content_length\").unwrap_or_default(),\n request_headers: serde_json::from_str(\n r.get::<_, String>(\"request_headers\").unwrap_or_default().as_str(),\n )\n .unwrap_or_default(),\n })\n }\n}\n\n/// Serializable representation of HTTP response events for DB storage.\n/// This mirrors `yaak_http::sender::HttpResponseEvent` but with serde support.\n/// The `From` impl is in yaak-http to avoid circular dependencies.\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(tag = \"type\", rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum HttpResponseEventData {\n Setting {\n name: String,\n value: String,\n },\n Info {\n message: String,\n },\n Redirect {\n url: String,\n status: u16,\n behavior: String,\n #[serde(default)]\n dropped_body: bool,\n #[serde(default)]\n dropped_headers: Vec,\n },\n SendUrl {\n method: String,\n #[serde(default)]\n scheme: String,\n #[serde(default)]\n username: String,\n #[serde(default)]\n password: String,\n #[serde(default)]\n host: String,\n #[serde(default)]\n port: u16,\n path: String,\n #[serde(default)]\n query: String,\n #[serde(default)]\n fragment: String,\n },\n ReceiveUrl {\n version: String,\n status: String,\n },\n HeaderUp {\n name: String,\n value: String,\n },\n HeaderDown {\n name: String,\n value: String,\n },\n ChunkSent {\n bytes: usize,\n },\n ChunkReceived {\n bytes: usize,\n },\n DnsResolved {\n hostname: String,\n addresses: Vec,\n duration: u64,\n overridden: bool,\n },\n}\n\nimpl Default for HttpResponseEventData {\n fn default() -> Self {\n Self::Info { message: String::new() }\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"http_response_events\")]\npub struct HttpResponseEvent {\n #[ts(type = \"\\\"http_response_event\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub response_id: String,\n pub event: HttpResponseEventData,\n}\n\nimpl UpsertModelInfo for HttpResponseEvent {\n fn table_name() -> impl IntoTableRef + IntoIden {\n HttpResponseEventIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n HttpResponseEventIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"re\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (HttpResponseEventIden::CreatedAt, Order::Asc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use HttpResponseEventIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (ResponseId, self.response_id.into()),\n (Event, serde_json::to_string(&self.event)?.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n HttpResponseEventIden::UpdatedAt,\n HttpResponseEventIden::Event,\n ]\n }\n\n fn from_row(r: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let event: String = r.get(\"event\")?;\n Ok(Self {\n id: r.get(\"id\")?,\n model: r.get(\"model\")?,\n workspace_id: r.get(\"workspace_id\")?,\n response_id: r.get(\"response_id\")?,\n created_at: r.get(\"created_at\")?,\n updated_at: r.get(\"updated_at\")?,\n event: serde_json::from_str(&event).unwrap_or_default(),\n })\n }\n}\n\nimpl HttpResponseEvent {\n pub fn new(response_id: &str, workspace_id: &str, event: HttpResponseEventData) -> Self {\n Self {\n model: \"http_response_event\".to_string(),\n id: Self::generate_id(),\n created_at: Utc::now().naive_utc(),\n updated_at: Utc::now().naive_utc(),\n workspace_id: workspace_id.to_string(),\n response_id: response_id.to_string(),\n event,\n }\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"graphql_introspections\")]\npub struct GraphQlIntrospection {\n #[ts(type = \"\\\"graphql_introspection\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub request_id: String,\n pub content: Option,\n}\n\nimpl UpsertModelInfo for GraphQlIntrospection {\n fn table_name() -> impl IntoTableRef + IntoIden {\n GraphQlIntrospectionIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n GraphQlIntrospectionIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"gi\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (GraphQlIntrospectionIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use GraphQlIntrospectionIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (RequestId, self.request_id.into()),\n (Content, self.content.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n GraphQlIntrospectionIden::UpdatedAt,\n GraphQlIntrospectionIden::Content,\n ]\n }\n\n fn from_row(r: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n Ok(Self {\n id: r.get(\"id\")?,\n model: r.get(\"model\")?,\n created_at: r.get(\"created_at\")?,\n updated_at: r.get(\"updated_at\")?,\n workspace_id: r.get(\"workspace_id\")?,\n request_id: r.get(\"request_id\")?,\n content: r.get(\"content\")?,\n })\n }\n}\n\n#[derive(Debug, Clone, PartialEq, Serialize, Deserialize, Default, JsonSchema, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"grpc_requests\")]\npub struct GrpcRequest {\n #[ts(type = \"\\\"grpc_request\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub folder_id: Option,\n\n pub authentication_type: Option,\n #[ts(type = \"Record\")]\n pub authentication: BTreeMap,\n pub description: String,\n pub message: String,\n pub metadata: Vec,\n pub method: Option,\n pub name: String,\n pub service: Option,\n pub sort_priority: f64,\n /// Server URL (http for plaintext or https for secure)\n pub url: String,\n}\n\nimpl UpsertModelInfo for GrpcRequest {\n fn table_name() -> impl IntoTableRef + IntoIden {\n GrpcRequestIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n GrpcRequestIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"gr\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (GrpcRequestIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use GrpcRequestIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (Name, self.name.trim().into()),\n (Description, self.description.into()),\n (WorkspaceId, self.workspace_id.into()),\n (FolderId, self.folder_id.into()),\n (SortPriority, self.sort_priority.into()),\n (Url, self.url.into()),\n (Service, self.service.into()),\n (Method, self.method.into()),\n (Message, self.message.into()),\n (AuthenticationType, self.authentication_type.into()),\n (Authentication, serde_json::to_string(&self.authentication)?.into()),\n (Metadata, serde_json::to_string(&self.metadata)?.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n GrpcRequestIden::UpdatedAt,\n GrpcRequestIden::WorkspaceId,\n GrpcRequestIden::Name,\n GrpcRequestIden::Description,\n GrpcRequestIden::FolderId,\n GrpcRequestIden::SortPriority,\n GrpcRequestIden::Url,\n GrpcRequestIden::Service,\n GrpcRequestIden::Method,\n GrpcRequestIden::Message,\n GrpcRequestIden::AuthenticationType,\n GrpcRequestIden::Authentication,\n GrpcRequestIden::Metadata,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let authentication: String = row.get(\"authentication\")?;\n let metadata: String = row.get(\"metadata\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n folder_id: row.get(\"folder_id\")?,\n name: row.get(\"name\")?,\n description: row.get(\"description\")?,\n service: row.get(\"service\")?,\n method: row.get(\"method\")?,\n message: row.get(\"message\")?,\n authentication_type: row.get(\"authentication_type\")?,\n authentication: serde_json::from_str(authentication.as_str()).unwrap_or_default(),\n url: row.get(\"url\")?,\n sort_priority: row.get(\"sort_priority\")?,\n metadata: serde_json::from_str(metadata.as_str()).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum GrpcConnectionState {\n Initialized,\n Connected,\n Closed,\n}\n\nimpl Default for GrpcConnectionState {\n fn default() -> Self {\n Self::Initialized\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"grpc_connections\")]\npub struct GrpcConnection {\n #[ts(type = \"\\\"grpc_connection\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub request_id: String,\n\n pub elapsed: i32,\n pub error: Option,\n pub method: String,\n pub service: String,\n pub status: i32,\n pub state: GrpcConnectionState,\n pub trailers: BTreeMap,\n pub url: String,\n}\n\nimpl UpsertModelInfo for GrpcConnection {\n fn table_name() -> impl IntoTableRef + IntoIden {\n GrpcConnectionIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n GrpcConnectionIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"gc\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (GrpcConnectionIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use GrpcConnectionIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (RequestId, self.request_id.into()),\n (Service, self.service.into()),\n (Method, self.method.into()),\n (Elapsed, self.elapsed.into()),\n (State, serde_json::to_value(&self.state)?.as_str().into()),\n (Status, self.status.into()),\n (Error, self.error.as_ref().map(|s| s.as_str()).into()),\n (Trailers, serde_json::to_string(&self.trailers)?.into()),\n (Url, self.url.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n GrpcConnectionIden::UpdatedAt,\n GrpcConnectionIden::Service,\n GrpcConnectionIden::Method,\n GrpcConnectionIden::Elapsed,\n GrpcConnectionIden::Status,\n GrpcConnectionIden::State,\n GrpcConnectionIden::Error,\n GrpcConnectionIden::Trailers,\n GrpcConnectionIden::Url,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let trailers: String = row.get(\"trailers\")?;\n let state: String = row.get(\"state\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n request_id: row.get(\"request_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n service: row.get(\"service\")?,\n method: row.get(\"method\")?,\n elapsed: row.get(\"elapsed\")?,\n state: serde_json::from_str(format!(r#\"\"{state}\"\"#).as_str()).unwrap(),\n status: row.get(\"status\")?,\n url: row.get(\"url\")?,\n error: row.get(\"error\")?,\n trailers: serde_json::from_str(trailers.as_str()).unwrap_or_default(),\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Eq, PartialEq, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum GrpcEventType {\n Info,\n Error,\n ClientMessage,\n ServerMessage,\n ConnectionStart,\n ConnectionEnd,\n}\n\nimpl Default for GrpcEventType {\n fn default() -> Self {\n GrpcEventType::Info\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"grpc_events\")]\npub struct GrpcEvent {\n #[ts(type = \"\\\"grpc_event\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub workspace_id: String,\n pub request_id: String,\n pub connection_id: String,\n\n pub content: String,\n pub error: Option,\n pub event_type: GrpcEventType,\n pub metadata: BTreeMap,\n pub status: Option,\n}\n\nimpl UpsertModelInfo for GrpcEvent {\n fn table_name() -> impl IntoTableRef + IntoIden {\n GrpcEventIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n GrpcEventIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"ge\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (GrpcEventIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use GrpcEventIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (RequestId, self.request_id.into()),\n (ConnectionId, self.connection_id.into()),\n (Content, self.content.into()),\n (EventType, serde_json::to_string(&self.event_type)?.into()),\n (Metadata, serde_json::to_string(&self.metadata)?.into()),\n (Status, self.status.into()),\n (Error, self.error.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n GrpcEventIden::UpdatedAt,\n GrpcEventIden::Content,\n GrpcEventIden::EventType,\n GrpcEventIden::Metadata,\n GrpcEventIden::Status,\n GrpcEventIden::Error,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n let event_type: String = row.get(\"event_type\")?;\n let metadata: String = row.get(\"metadata\")?;\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n workspace_id: row.get(\"workspace_id\")?,\n request_id: row.get(\"request_id\")?,\n connection_id: row.get(\"connection_id\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n content: row.get(\"content\")?,\n event_type: serde_json::from_str(event_type.as_str()).unwrap_or_default(),\n metadata: serde_json::from_str(metadata.as_str()).unwrap_or_default(),\n status: row.get(\"status\")?,\n error: row.get(\"error\")?,\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"plugins\")]\npub struct Plugin {\n #[ts(type = \"\\\"plugin\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n\n pub checked_at: Option,\n pub directory: String,\n pub enabled: bool,\n pub url: Option,\n pub source: PluginSource,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum PluginSource {\n Bundled,\n Filesystem,\n Registry,\n}\n\nimpl FromStr for PluginSource {\n type Err = crate::error::Error;\n\n fn from_str(s: &str) -> Result {\n match s {\n \"bundled\" => Ok(Self::Bundled),\n \"filesystem\" => Ok(Self::Filesystem),\n \"registry\" => Ok(Self::Registry),\n _ => Ok(Self::default()),\n }\n }\n}\n\nimpl Display for PluginSource {\n fn fmt(&self, f: &mut std::fmt::Formatter<'_>) -> std::fmt::Result {\n let str = match self {\n PluginSource::Bundled => \"bundled\".to_string(),\n PluginSource::Filesystem => \"filesystem\".to_string(),\n PluginSource::Registry => \"registry\".to_string(),\n };\n write!(f, \"{}\", str)\n }\n}\n\nimpl Default for PluginSource {\n fn default() -> Self {\n Self::Filesystem\n }\n}\n\nimpl UpsertModelInfo for Plugin {\n fn table_name() -> impl IntoTableRef + IntoIden {\n PluginIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n PluginIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"pg\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (PluginIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use PluginIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (CheckedAt, self.checked_at.into()),\n (Directory, self.directory.into()),\n (Url, self.url.into()),\n (Enabled, self.enabled.into()),\n (Source, self.source.to_string().into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n PluginIden::UpdatedAt,\n PluginIden::CheckedAt,\n PluginIden::Directory,\n PluginIden::Url,\n PluginIden::Enabled,\n PluginIden::Source,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n checked_at: row.get(\"checked_at\")?,\n url: row.get(\"url\")?,\n directory: row.get(\"directory\")?,\n enabled: row.get(\"enabled\")?,\n source: PluginSource::from_str(row.get::<_, String>(\"source\")?.as_str()).unwrap(),\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"sync_states\")]\npub struct SyncState {\n #[ts(type = \"\\\"sync_state\\\"\")]\n pub model: String,\n pub id: String,\n pub workspace_id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n pub flushed_at: NaiveDateTime,\n\n pub model_id: String,\n pub checksum: String,\n pub rel_path: String,\n pub sync_dir: String,\n}\n\nimpl UpsertModelInfo for SyncState {\n fn table_name() -> impl IntoTableRef + IntoIden {\n SyncStateIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n SyncStateIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"ss\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (SyncStateIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use SyncStateIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (WorkspaceId, self.workspace_id.into()),\n (FlushedAt, self.flushed_at.into()),\n (Checksum, self.checksum.into()),\n (ModelId, self.model_id.into()),\n (RelPath, self.rel_path.into()),\n (SyncDir, self.sync_dir.into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![\n SyncStateIden::UpdatedAt,\n SyncStateIden::FlushedAt,\n SyncStateIden::Checksum,\n SyncStateIden::RelPath,\n SyncStateIden::SyncDir,\n ]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n Ok(Self {\n id: row.get(\"id\")?,\n workspace_id: row.get(\"workspace_id\")?,\n model: row.get(\"model\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n flushed_at: row.get(\"flushed_at\")?,\n checksum: row.get(\"checksum\")?,\n model_id: row.get(\"model_id\")?,\n sync_dir: row.get(\"sync_dir\")?,\n rel_path: row.get(\"rel_path\")?,\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"key_values\")]\npub struct KeyValue {\n #[ts(type = \"\\\"key_value\\\"\")]\n pub model: String,\n pub id: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n\n pub key: String,\n pub namespace: String,\n pub value: String,\n}\n\nimpl UpsertModelInfo for KeyValue {\n fn table_name() -> impl IntoTableRef + IntoIden {\n KeyValueIden::Table\n }\n\n fn id_column() -> impl IntoIden + Eq + Clone {\n KeyValueIden::Id\n }\n\n fn generate_id() -> String {\n generate_prefixed_id(\"kv\")\n }\n\n fn order_by() -> (impl IntoColumnRef, Order) {\n (KeyValueIden::CreatedAt, Desc)\n }\n\n fn get_id(&self) -> String {\n self.id.clone()\n }\n\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>> {\n use KeyValueIden::*;\n Ok(vec![\n (CreatedAt, upsert_date(source, self.created_at)),\n (UpdatedAt, upsert_date(source, self.updated_at)),\n (Namespace, self.namespace.clone().into()),\n (Key, self.key.clone().into()),\n (Value, self.value.clone().into()),\n ])\n }\n\n fn update_columns() -> Vec {\n vec![KeyValueIden::UpdatedAt, KeyValueIden::Value]\n }\n\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized,\n {\n Ok(Self {\n id: row.get(\"id\")?,\n model: row.get(\"model\")?,\n created_at: row.get(\"created_at\")?,\n updated_at: row.get(\"updated_at\")?,\n namespace: row.get(\"namespace\")?,\n key: row.get(\"key\")?,\n value: row.get(\"value\")?,\n })\n }\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, Default, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\n#[enum_def(table_name = \"plugin_key_values\")]\npub struct PluginKeyValue {\n #[ts(type = \"\\\"plugin_key_value\\\"\")]\n pub model: String,\n pub created_at: NaiveDateTime,\n pub updated_at: NaiveDateTime,\n\n pub plugin_name: String,\n pub key: String,\n pub value: String,\n}\n\nimpl<'s> TryFrom<&Row<'s>> for PluginKeyValue {\n type Error = rusqlite::Error;\n\n fn try_from(r: &Row<'s>) -> std::result::Result {\n Ok(Self {\n model: r.get(\"model\")?,\n created_at: r.get(\"created_at\")?,\n updated_at: r.get(\"updated_at\")?,\n plugin_name: r.get(\"plugin_name\")?,\n key: r.get(\"key\")?,\n value: r.get(\"value\")?,\n })\n }\n}\n\nfn default_true() -> bool {\n true\n}\n\nfn default_http_method() -> String {\n \"GET\".to_string()\n}\n\n#[macro_export]\nmacro_rules! define_any_model {\n ($($type:ident),* $(,)?) => {\n #[derive(Debug, Clone, Serialize, TS)]\n #[serde(rename_all = \"camelCase\", untagged)]\n #[ts(export, export_to = \"gen_models.ts\")]\n pub enum AnyModel {\n $(\n $type($type),\n )*\n }\n\n impl AnyModel {\n #[inline]\n pub fn id(&self) -> &str {\n match self {\n $(\n AnyModel::$type(inner) => &inner.id,\n )*\n }\n }\n\n #[inline]\n pub fn model(&self) -> &str {\n match self {\n $(\n AnyModel::$type(inner) => &inner.model,\n )*\n }\n }\n }\n\n $(\n impl From<$type> for AnyModel {\n fn from(value: $type) -> Self {\n AnyModel::$type(value)\n }\n }\n\n impl From for $type {\n fn from(value: AnyModel) -> $type {\n match value {\n AnyModel::$type(inner) => inner,\n _ => panic!( // Should never happen because this macro also generates the enum variant\n \"Tried to convert AnyModel into `{}`, but found a different variant\",\n stringify!($type)\n ),\n }\n }\n }\n )*\n };\n}\n\ndefine_any_model! {\n CookieJar,\n Environment,\n Folder,\n GraphQlIntrospection,\n GrpcConnection,\n GrpcEvent,\n GrpcRequest,\n HttpRequest,\n HttpResponse,\n HttpResponseEvent,\n KeyValue,\n Plugin,\n Settings,\n SyncState,\n WebsocketConnection,\n WebsocketEvent,\n WebsocketRequest,\n Workspace,\n WorkspaceMeta,\n}\n\nimpl<'de> Deserialize<'de> for AnyModel {\n fn deserialize(deserializer: D) -> std::result::Result\n where\n D: Deserializer<'de>,\n {\n let value = Value::deserialize(deserializer)?;\n let model = value.as_object().unwrap();\n use AnyModel::*;\n use serde_json::from_value as fv;\n\n let model = match model.get(\"model\") {\n Some(m) if m == \"cookie_jar\" => CookieJar(fv(value).unwrap()),\n Some(m) if m == \"environment\" => Environment(fv(value).unwrap()),\n Some(m) if m == \"folder\" => Folder(fv(value).unwrap()),\n Some(m) if m == \"graphql_introspection\" => GraphQlIntrospection(fv(value).unwrap()),\n Some(m) if m == \"grpc_connection\" => GrpcConnection(fv(value).unwrap()),\n Some(m) if m == \"grpc_event\" => GrpcEvent(fv(value).unwrap()),\n Some(m) if m == \"grpc_request\" => GrpcRequest(fv(value).unwrap()),\n Some(m) if m == \"http_request\" => HttpRequest(fv(value).unwrap()),\n Some(m) if m == \"http_response\" => HttpResponse(fv(value).unwrap()),\n Some(m) if m == \"http_response_event\" => HttpResponseEvent(fv(value).unwrap()),\n Some(m) if m == \"key_value\" => KeyValue(fv(value).unwrap()),\n Some(m) if m == \"plugin\" => Plugin(fv(value).unwrap()),\n Some(m) if m == \"settings\" => Settings(fv(value).unwrap()),\n Some(m) if m == \"sync_state\" => SyncState(fv(value).unwrap()),\n Some(m) if m == \"websocket_connection\" => WebsocketConnection(fv(value).unwrap()),\n Some(m) if m == \"websocket_event\" => WebsocketEvent(fv(value).unwrap()),\n Some(m) if m == \"websocket_request\" => WebsocketRequest(fv(value).unwrap()),\n Some(m) if m == \"workspace\" => Workspace(fv(value).unwrap()),\n Some(m) if m == \"workspace_meta\" => WorkspaceMeta(fv(value).unwrap()),\n Some(m) => {\n return Err(serde::de::Error::custom(format!(\n \"Failed to deserialize AnyModel {}\",\n m\n )));\n }\n None => {\n return Err(serde::de::Error::custom(\"Missing or invalid model\"));\n }\n };\n\n Ok(model)\n }\n}\n\nimpl AnyModel {\n pub fn resolved_name(&self) -> String {\n let compute_name = |name: &str, url: &str, fallback: &str| -> String {\n if !name.is_empty() {\n return name.to_string();\n }\n let without_variables = url.replace(r\"\\$\\{\\[\\s*([^\\]\\s]+)\\s*]}\", \"$1\");\n if without_variables.is_empty() { fallback.to_string() } else { without_variables }\n };\n\n match self.clone() {\n AnyModel::CookieJar(v) => v.name,\n AnyModel::Environment(v) => v.name,\n AnyModel::Folder(v) => v.name,\n AnyModel::GrpcRequest(v) => compute_name(&v.name, &v.url, \"gRPC Request\"),\n AnyModel::HttpRequest(v) => compute_name(&v.name, &v.url, \"HTTP Request\"),\n AnyModel::WebsocketRequest(v) => compute_name(&v.name, &v.url, \"WebSocket Request\"),\n AnyModel::Workspace(v) => v.name,\n _ => \"No Name\".to_string(),\n }\n }\n}\n\npub trait UpsertModelInfo {\n fn table_name() -> impl IntoTableRef + IntoIden;\n fn id_column() -> impl IntoIden + Eq + Clone;\n fn generate_id() -> String;\n fn order_by() -> (impl IntoColumnRef, Order);\n fn get_id(&self) -> String;\n fn insert_values(\n self,\n source: &UpdateSource,\n ) -> Result)>>;\n fn update_columns() -> Vec;\n fn from_row(row: &Row) -> rusqlite::Result\n where\n Self: Sized;\n}\n\n// Generate the created_at or updated_at timestamps for an upsert operation, depending on the ID\n// provided.\nfn upsert_date(update_source: &UpdateSource, dt: NaiveDateTime) -> SimpleExpr {\n match update_source {\n // Sync and import operations always preserve timestamps\n UpdateSource::Sync | UpdateSource::Import => {\n if dt.and_utc().timestamp() == 0 {\n // Sometimes data won't have timestamps (partial data)\n Utc::now().naive_utc().into()\n } else {\n dt.into()\n }\n }\n // Other sources will always update to the latest time\n _ => Utc::now().naive_utc().into(),\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/any_request.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{GrpcRequest, HttpRequest, WebsocketRequest};\n\npub enum AnyRequest {\n HttpRequest(HttpRequest),\n GrpcRequest(GrpcRequest),\n WebsocketRequest(WebsocketRequest),\n}\n\nimpl<'a> DbContext<'a> {\n pub fn get_any_request(&self, id: &str) -> Result {\n if let Ok(http_request) = self.get_http_request(id) {\n Ok(AnyRequest::HttpRequest(http_request))\n } else if let Ok(grpc_request) = self.get_grpc_request(id) {\n Ok(AnyRequest::GrpcRequest(grpc_request))\n } else {\n Ok(AnyRequest::WebsocketRequest(self.get_websocket_request(id)?))\n }\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/batch.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{Environment, Folder, GrpcRequest, HttpRequest, WebsocketRequest, Workspace};\nuse crate::util::{BatchUpsertResult, UpdateSource};\nuse log::info;\n\nimpl<'a> DbContext<'a> {\n pub fn batch_upsert(\n &self,\n workspaces: Vec,\n environments: Vec,\n folders: Vec,\n http_requests: Vec,\n grpc_requests: Vec,\n websocket_requests: Vec,\n source: &UpdateSource,\n ) -> Result {\n let mut imported_resources = BatchUpsertResult::default();\n\n if workspaces.len() > 0 {\n for v in workspaces {\n let x = self.upsert_workspace(&v, source)?;\n imported_resources.workspaces.push(x.clone());\n }\n info!(\"Upserted {} workspaces\", imported_resources.workspaces.len());\n }\n\n if http_requests.len() > 0 {\n for v in http_requests {\n let x = self.upsert_http_request(&v, source)?;\n imported_resources.http_requests.push(x.clone());\n }\n info!(\"Upserted Imported {} http_requests\", imported_resources.http_requests.len());\n }\n\n if grpc_requests.len() > 0 {\n for v in grpc_requests {\n let x = self.upsert_grpc_request(&v, source)?;\n imported_resources.grpc_requests.push(x.clone());\n }\n info!(\"Upserted {} grpc_requests\", imported_resources.grpc_requests.len());\n }\n\n if websocket_requests.len() > 0 {\n for v in websocket_requests {\n let x = self.upsert_websocket_request(&v, source)?;\n imported_resources.websocket_requests.push(x.clone());\n }\n info!(\"Upserted {} websocket_requests\", imported_resources.websocket_requests.len());\n }\n\n // Do folders after their children so the UI doesn't render empty folders before populating\n // immediately after.\n if folders.len() > 0 {\n for v in folders {\n let x = self.upsert_folder(&v, source)?;\n imported_resources.folders.push(x.clone());\n }\n info!(\"Upserted {} folders\", imported_resources.folders.len());\n }\n\n // Do environments last because they can depend on many models (requests, folders, etc)\n if environments.len() > 0 {\n for x in environments {\n let x = self.upsert_environment(&x, source)?;\n imported_resources.environments.push(x.clone());\n }\n info!(\"Upserted {} environments\", imported_resources.environments.len());\n }\n\n Ok(imported_resources)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/cookie_jars.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{CookieJar, CookieJarIden};\nuse crate::util::UpdateSource;\n\nimpl<'a> DbContext<'a> {\n pub fn get_cookie_jar(&self, id: &str) -> Result {\n self.find_one(CookieJarIden::Id, id)\n }\n\n pub fn list_cookie_jars(&self, workspace_id: &str) -> Result> {\n let mut cookie_jars = self.find_many(CookieJarIden::WorkspaceId, workspace_id, None)?;\n\n if cookie_jars.is_empty() {\n let jar = CookieJar {\n name: \"Default\".to_string(),\n workspace_id: workspace_id.to_string(),\n ..Default::default()\n };\n cookie_jars.push(self.upsert_cookie_jar(&jar, &UpdateSource::Background)?);\n }\n\n Ok(cookie_jars)\n }\n\n pub fn delete_cookie_jar(\n &self,\n cookie_jar: &CookieJar,\n source: &UpdateSource,\n ) -> Result {\n self.delete(cookie_jar, source)\n }\n\n pub fn delete_cookie_jar_by_id(&self, id: &str, source: &UpdateSource) -> Result {\n let cookie_jar = self.get_cookie_jar(id)?;\n self.delete_cookie_jar(&cookie_jar, source)\n }\n\n pub fn upsert_cookie_jar(\n &self,\n cookie_jar: &CookieJar,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(cookie_jar, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/environments.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Error::{MissingBaseEnvironment, MultipleBaseEnvironments};\nuse crate::error::Result;\nuse crate::models::{Environment, EnvironmentIden, EnvironmentVariable};\nuse crate::util::UpdateSource;\nuse log::{info, warn};\n\nimpl<'a> DbContext<'a> {\n pub fn get_environment(&self, id: &str) -> Result {\n self.find_one(EnvironmentIden::Id, id)\n }\n\n pub fn get_environment_by_folder_id(&self, folder_id: &str) -> Result> {\n let mut environments: Vec =\n self.find_many(EnvironmentIden::ParentId, folder_id, None)?;\n // Sort so we return the most recently updated environment\n environments.sort_by(|a, b| b.updated_at.cmp(&a.updated_at));\n Ok(environments.get(0).cloned())\n }\n\n pub fn get_base_environment(&self, workspace_id: &str) -> Result {\n let environments = self.list_environments_ensure_base(workspace_id)?;\n let base_environments = environments\n .into_iter()\n .filter(|e| e.parent_model == \"workspace\")\n .collect::>();\n\n if base_environments.len() > 1 {\n return Err(MultipleBaseEnvironments(workspace_id.to_string()));\n }\n\n Ok(base_environments.first().cloned().ok_or(\n // Should never happen because one should be created above if it does not exist\n MissingBaseEnvironment(workspace_id.to_string()),\n )?)\n }\n\n /// Lists environments and will create a base environment if one doesn't exist\n pub fn list_environments_ensure_base(&self, workspace_id: &str) -> Result> {\n let mut environments = self.list_environments_dangerous(workspace_id)?;\n\n let base_environment = environments.iter().find(|e| e.parent_model == \"workspace\");\n\n if let None = base_environment {\n let e = self.upsert_environment(\n &Environment {\n workspace_id: workspace_id.to_string(),\n name: \"Global Variables\".to_string(),\n parent_model: \"workspace\".to_string(),\n ..Default::default()\n },\n &UpdateSource::Background,\n )?;\n info!(\"Created base environment {} for {workspace_id}\", e.id);\n environments.push(e);\n }\n\n Ok(environments)\n }\n\n /// List environments for a workspace. Prefer list_environments_ensure_base()\n fn list_environments_dangerous(&self, workspace_id: &str) -> Result> {\n Ok(self.find_many::(EnvironmentIden::WorkspaceId, workspace_id, None)?)\n }\n\n pub fn delete_environment(\n &self,\n environment: &Environment,\n source: &UpdateSource,\n ) -> Result {\n let deleted_environment = self.delete(environment, source)?;\n\n // Recreate the base environment if we happened to delete it\n self.list_environments_ensure_base(&environment.workspace_id)?;\n\n Ok(deleted_environment)\n }\n\n pub fn delete_environment_by_id(&self, id: &str, source: &UpdateSource) -> Result {\n let environment = self.get_environment(id)?;\n self.delete_environment(&environment, source)\n }\n\n pub fn duplicate_environment(\n &self,\n environment: &Environment,\n source: &UpdateSource,\n ) -> Result {\n let mut environment = environment.clone();\n environment.id = \"\".to_string();\n self.upsert_environment(&environment, source)\n }\n\n /// Find other environments with the same parent folder\n fn list_duplicate_folder_environments(&self, environment: &Environment) -> Vec {\n if environment.parent_model != \"folder\" {\n return Vec::new();\n }\n\n self.list_environments_dangerous(&environment.workspace_id)\n .unwrap_or_default()\n .into_iter()\n .filter(|e| {\n e.id != environment.id\n && e.parent_model == \"folder\"\n && e.parent_id == environment.parent_id\n })\n .collect()\n }\n\n pub fn upsert_environment(\n &self,\n environment: &Environment,\n source: &UpdateSource,\n ) -> Result {\n let cleaned_variables = environment\n .variables\n .iter()\n .filter(|v| !v.name.is_empty() || !v.value.is_empty())\n .cloned()\n .collect::>();\n\n // Sometimes a new environment can be created via sync/import, so we'll just delete\n // the others when that happens. Not the best, but it's good for now.\n let duplicates = self.list_duplicate_folder_environments(environment);\n for duplicate in duplicates {\n warn!(\n \"Deleting duplicate environment {} for folder {:?}\",\n duplicate.id, environment.parent_id\n );\n _ = self.delete(&duplicate, source);\n }\n\n // Automatically update the environment name based on the folder name\n let mut name = environment.name.clone();\n match (environment.parent_model.as_str(), environment.parent_id.as_deref()) {\n (\"folder\", Some(folder_id)) => {\n if let Ok(folder) = self.get_folder(folder_id) {\n name = format!(\"{} Environment\", folder.name);\n }\n }\n _ => {}\n }\n\n self.upsert(\n &Environment { name, variables: cleaned_variables, ..environment.clone() },\n source,\n )\n }\n\n pub fn resolve_environments(\n &self,\n workspace_id: &str,\n folder_id: Option<&str>,\n active_environment_id: Option<&str>,\n ) -> Result> {\n let mut environments = Vec::new();\n\n if let Some(folder_id) = folder_id {\n let folder = self.get_folder(folder_id)?;\n\n // Add current folder's environment\n if let Some(e) = self.get_environment_by_folder_id(folder_id)? {\n environments.push(e);\n };\n\n // Recurse up\n let ancestors = self.resolve_environments(\n workspace_id,\n folder.folder_id.as_deref(),\n active_environment_id,\n )?;\n environments.extend(ancestors);\n } else {\n // Add active and base environments\n if let Some(id) = active_environment_id {\n if let Ok(e) = self.get_environment(&id) {\n // Add active sub environment\n environments.push(e);\n };\n };\n\n // Add the base environment\n environments.push(self.get_base_environment(workspace_id)?);\n }\n\n Ok(environments)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/folders.rs", "content": "use crate::connection_or_tx::ConnectionOrTx;\nuse crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{\n Environment, EnvironmentIden, Folder, FolderIden, GrpcRequest, GrpcRequestIden, HttpRequest,\n HttpRequestHeader, HttpRequestIden, WebsocketRequest, WebsocketRequestIden,\n};\nuse crate::util::UpdateSource;\nuse serde_json::Value;\nuse std::collections::BTreeMap;\n\nimpl<'a> DbContext<'a> {\n pub fn get_folder(&self, id: &str) -> Result {\n self.find_one(FolderIden::Id, id)\n }\n\n pub fn list_folders(&self, workspace_id: &str) -> Result> {\n self.find_many(FolderIden::WorkspaceId, workspace_id, None)\n }\n\n pub fn delete_folder(&self, folder: &Folder, source: &UpdateSource) -> Result {\n match self.conn {\n ConnectionOrTx::Connection(_) => {}\n ConnectionOrTx::Transaction(_) => {}\n }\n\n let fid = &folder.id;\n for m in self.find_many::(HttpRequestIden::FolderId, fid, None)? {\n self.delete_http_request(&m, source)?;\n }\n\n for m in self.find_many::(GrpcRequestIden::FolderId, fid, None)? {\n self.delete_grpc_request(&m, source)?;\n }\n\n for m in self.find_many::(WebsocketRequestIden::FolderId, fid, None)? {\n self.delete_websocket_request(&m, source)?;\n }\n\n for e in self.find_many(EnvironmentIden::ParentId, fid, None)? {\n self.delete_environment(&e, source)?;\n }\n\n // Recurse down into child folders\n for folder in self.find_many::(FolderIden::FolderId, fid, None)? {\n self.delete_folder(&folder, source)?;\n }\n\n self.delete(folder, source)\n }\n\n pub fn delete_folder_by_id(&self, id: &str, source: &UpdateSource) -> Result {\n let folder = self.get_folder(id)?;\n self.delete_folder(&folder, source)\n }\n\n pub fn upsert_folder(&self, folder: &Folder, source: &UpdateSource) -> Result {\n self.upsert(folder, source)\n }\n\n pub fn duplicate_folder(&self, src_folder: &Folder, source: &UpdateSource) -> Result {\n let fid = &src_folder.id;\n\n let new_folder = self.upsert_folder(\n &Folder {\n id: \"\".into(),\n sort_priority: src_folder.sort_priority + 0.001,\n ..src_folder.clone()\n },\n source,\n )?;\n\n for m in self.find_many::(HttpRequestIden::FolderId, fid, None)? {\n self.upsert_http_request(\n &HttpRequest { id: \"\".into(), folder_id: Some(new_folder.id.clone()), ..m },\n source,\n )?;\n }\n\n for m in self.find_many::(WebsocketRequestIden::FolderId, fid, None)? {\n self.upsert_websocket_request(\n &WebsocketRequest { id: \"\".into(), folder_id: Some(new_folder.id.clone()), ..m },\n source,\n )?;\n }\n\n for m in self.find_many::(GrpcRequestIden::FolderId, fid, None)? {\n self.upsert_grpc_request(\n &GrpcRequest { id: \"\".into(), folder_id: Some(new_folder.id.clone()), ..m },\n source,\n )?;\n }\n\n for m in self.find_many::(EnvironmentIden::ParentId, fid, None)? {\n self.upsert_environment(\n &Environment { id: \"\".into(), parent_id: Some(new_folder.id.clone()), ..m },\n source,\n )?;\n }\n\n for m in self.find_many::(FolderIden::FolderId, fid, None)? {\n // Recurse down\n self.duplicate_folder(&Folder { folder_id: Some(new_folder.id.clone()), ..m }, source)?;\n }\n\n Ok(new_folder)\n }\n\n pub fn resolve_auth_for_folder(\n &self,\n folder: &Folder,\n ) -> Result<(Option, BTreeMap, String)> {\n if let Some(at) = folder.authentication_type.clone() {\n return Ok((Some(at), folder.authentication.clone(), folder.id.clone()));\n }\n\n if let Some(folder_id) = folder.folder_id.clone() {\n let folder = self.get_folder(&folder_id)?;\n return self.resolve_auth_for_folder(&folder);\n }\n\n let workspace = self.get_workspace(&folder.workspace_id)?;\n Ok(self.resolve_auth_for_workspace(&workspace))\n }\n\n pub fn resolve_headers_for_folder(&self, folder: &Folder) -> Result> {\n let mut headers = Vec::new();\n\n if let Some(folder_id) = folder.folder_id.clone() {\n let parent_folder = self.get_folder(&folder_id)?;\n let mut folder_headers = self.resolve_headers_for_folder(&parent_folder)?;\n // NOTE: Add parent headers first, so overrides are logical\n headers.append(&mut folder_headers);\n } else {\n let workspace = self.get_workspace(&folder.workspace_id)?;\n let mut workspace_headers = self.resolve_headers_for_workspace(&workspace);\n headers.append(&mut workspace_headers);\n }\n\n headers.append(&mut folder.headers.clone());\n\n Ok(headers)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/graphql_introspections.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{GraphQlIntrospection, GraphQlIntrospectionIden};\nuse crate::util::UpdateSource;\nuse chrono::{Duration, Utc};\nuse sea_query::{Expr, Query, SqliteQueryBuilder};\nuse sea_query_rusqlite::RusqliteBinder;\n\nimpl<'a> DbContext<'a> {\n pub fn get_graphql_introspection(&self, request_id: &str) -> Option {\n self.find_optional(GraphQlIntrospectionIden::RequestId, request_id)\n }\n\n pub fn upsert_graphql_introspection(\n &self,\n workspace_id: &str,\n request_id: &str,\n content: Option,\n source: &UpdateSource,\n ) -> Result {\n // Clean up old ones every time a new one is upserted\n self.delete_expired_graphql_introspections()?;\n\n match self.get_graphql_introspection(request_id) {\n None => self.upsert(\n &GraphQlIntrospection {\n content,\n request_id: request_id.to_string(),\n workspace_id: workspace_id.to_string(),\n ..Default::default()\n },\n source,\n ),\n Some(introspection) => {\n self.upsert(&GraphQlIntrospection { content, ..introspection }, source)\n }\n }\n }\n\n pub fn delete_expired_graphql_introspections(&self) -> Result<()> {\n let cutoff = Utc::now().naive_utc() - Duration::days(7);\n let (sql, params) = Query::delete()\n .from_table(GraphQlIntrospectionIden::Table)\n .cond_where(Expr::col(GraphQlIntrospectionIden::UpdatedAt).lt(cutoff))\n .build_rusqlite(SqliteQueryBuilder);\n\n let mut stmt = self.conn.resolve().prepare(sql.as_str())?;\n stmt.execute(&*params.as_params())?;\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/grpc_connections.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{GrpcConnection, GrpcConnectionIden, GrpcConnectionState};\nuse crate::queries::MAX_HISTORY_ITEMS;\nuse crate::util::UpdateSource;\nuse log::debug;\nuse sea_query::{Expr, Query, SqliteQueryBuilder};\nuse sea_query_rusqlite::RusqliteBinder;\n\nimpl<'a> DbContext<'a> {\n pub fn get_grpc_connection(&self, id: &str) -> Result {\n self.find_one(GrpcConnectionIden::Id, id)\n }\n\n pub fn delete_all_grpc_connections_for_request(\n &self,\n request_id: &str,\n source: &UpdateSource,\n ) -> Result<()> {\n let responses = self.list_grpc_connections_for_request(request_id, None)?;\n for m in responses {\n self.delete(&m, source)?;\n }\n Ok(())\n }\n\n pub fn delete_all_grpc_connections_for_workspace(\n &self,\n workspace_id: &str,\n source: &UpdateSource,\n ) -> Result<()> {\n for m in self.list_grpc_connections(workspace_id)? {\n self.delete(&m, source)?;\n }\n Ok(())\n }\n\n pub fn delete_grpc_connection(\n &self,\n m: &GrpcConnection,\n source: &UpdateSource,\n ) -> Result {\n self.delete(m, source)\n }\n\n pub fn delete_grpc_connection_by_id(\n &self,\n id: &str,\n source: &UpdateSource,\n ) -> Result {\n let grpc_connection = self.get_grpc_connection(id)?;\n self.delete_grpc_connection(&grpc_connection, source)\n }\n\n pub fn list_grpc_connections_for_request(\n &self,\n request_id: &str,\n limit: Option,\n ) -> Result> {\n self.find_many(GrpcConnectionIden::RequestId, request_id, limit)\n }\n\n pub fn list_grpc_connections(&self, workspace_id: &str) -> Result> {\n self.find_many(GrpcConnectionIden::WorkspaceId, workspace_id, None)\n }\n\n pub fn cancel_pending_grpc_connections(&self) -> Result<()> {\n let closed = serde_json::to_value(&GrpcConnectionState::Closed)?;\n let (sql, params) = Query::update()\n .table(GrpcConnectionIden::Table)\n .values([(GrpcConnectionIden::State, closed.as_str().into())])\n .cond_where(Expr::col(GrpcConnectionIden::State).ne(closed.as_str()))\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.prepare(sql.as_str())?;\n stmt.execute(&*params.as_params())?;\n Ok(())\n }\n\n pub fn upsert_grpc_connection(\n &self,\n grpc_connection: &GrpcConnection,\n source: &UpdateSource,\n ) -> Result {\n let connections =\n self.list_grpc_connections_for_request(grpc_connection.request_id.as_str(), None)?;\n\n for m in connections.iter().skip(MAX_HISTORY_ITEMS - 1) {\n debug!(\"Deleting old gRPC connection {}\", grpc_connection.id);\n self.delete_grpc_connection(&m, source)?;\n }\n\n self.upsert(grpc_connection, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/grpc_events.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{GrpcEvent, GrpcEventIden};\nuse crate::util::UpdateSource;\n\nimpl<'a> DbContext<'a> {\n pub fn get_grpc_events(&self, id: &str) -> Result {\n self.find_one(GrpcEventIden::Id, id)\n }\n\n pub fn list_grpc_events(&self, connection_id: &str) -> Result> {\n self.find_many(GrpcEventIden::ConnectionId, connection_id, None)\n }\n\n pub fn upsert_grpc_event(\n &self,\n grpc_event: &GrpcEvent,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(grpc_event, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/grpc_requests.rs", "content": "use super::dedupe_headers;\nuse crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{Folder, FolderIden, GrpcRequest, GrpcRequestIden, HttpRequestHeader};\nuse crate::util::UpdateSource;\nuse serde_json::Value;\nuse std::collections::BTreeMap;\n\nimpl<'a> DbContext<'a> {\n pub fn get_grpc_request(&self, id: &str) -> Result {\n self.find_one(GrpcRequestIden::Id, id)\n }\n\n pub fn list_grpc_requests(&self, workspace_id: &str) -> Result> {\n self.find_many(GrpcRequestIden::WorkspaceId, workspace_id, None)\n }\n\n pub fn list_grpc_requests_for_folder_recursive(\n &self,\n folder_id: &str,\n ) -> Result> {\n let mut children = Vec::new();\n for folder in self.find_many::(FolderIden::FolderId, folder_id, None)? {\n children.extend(self.list_grpc_requests_for_folder_recursive(&folder.id)?);\n }\n for request in self.find_many::(GrpcRequestIden::FolderId, folder_id, None)? {\n children.push(request);\n }\n Ok(children)\n }\n\n pub fn delete_grpc_request(\n &self,\n m: &GrpcRequest,\n source: &UpdateSource,\n ) -> Result {\n self.delete_all_grpc_connections_for_request(m.id.as_str(), source)?;\n self.delete(m, source)\n }\n\n pub fn delete_grpc_request_by_id(\n &self,\n id: &str,\n source: &UpdateSource,\n ) -> Result {\n let request = self.get_grpc_request(id)?;\n self.delete_grpc_request(&request, source)\n }\n\n pub fn duplicate_grpc_request(\n &self,\n grpc_request: &GrpcRequest,\n source: &UpdateSource,\n ) -> Result {\n let mut request = grpc_request.clone();\n request.id = \"\".to_string();\n request.sort_priority = request.sort_priority + 0.001;\n self.upsert(&request, source)\n }\n\n pub fn upsert_grpc_request(\n &self,\n grpc_request: &GrpcRequest,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(grpc_request, source)\n }\n\n pub fn resolve_auth_for_grpc_request(\n &self,\n grpc_request: &GrpcRequest,\n ) -> Result<(Option, BTreeMap, String)> {\n if let Some(at) = grpc_request.authentication_type.clone() {\n return Ok((Some(at), grpc_request.authentication.clone(), grpc_request.id.clone()));\n }\n\n if let Some(folder_id) = grpc_request.folder_id.clone() {\n let folder = self.get_folder(&folder_id)?;\n return self.resolve_auth_for_folder(&folder);\n }\n\n let workspace = self.get_workspace(&grpc_request.workspace_id)?;\n Ok(self.resolve_auth_for_workspace(&workspace))\n }\n\n pub fn resolve_metadata_for_grpc_request(\n &self,\n grpc_request: &GrpcRequest,\n ) -> Result> {\n // Resolved headers should be from furthest to closest ancestor, to override logically.\n let mut metadata = Vec::new();\n\n if let Some(folder_id) = grpc_request.folder_id.clone() {\n let parent_folder = self.get_folder(&folder_id)?;\n let mut folder_headers = self.resolve_headers_for_folder(&parent_folder)?;\n metadata.append(&mut folder_headers);\n } else {\n let workspace = self.get_workspace(&grpc_request.workspace_id)?;\n let mut workspace_metadata = self.resolve_headers_for_workspace(&workspace);\n metadata.append(&mut workspace_metadata);\n }\n\n metadata.append(&mut grpc_request.metadata.clone());\n\n Ok(dedupe_headers(metadata))\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/http_requests.rs", "content": "use super::dedupe_headers;\nuse crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{Folder, FolderIden, HttpRequest, HttpRequestHeader, HttpRequestIden};\nuse crate::util::UpdateSource;\nuse serde_json::Value;\nuse std::collections::BTreeMap;\n\nimpl<'a> DbContext<'a> {\n pub fn get_http_request(&self, id: &str) -> Result {\n self.find_one(HttpRequestIden::Id, id)\n }\n\n pub fn list_http_requests(&self, workspace_id: &str) -> Result> {\n self.find_many(HttpRequestIden::WorkspaceId, workspace_id, None)\n }\n\n pub fn delete_http_request(\n &self,\n m: &HttpRequest,\n source: &UpdateSource,\n ) -> Result {\n self.delete_all_http_responses_for_request(m.id.as_str(), source)?;\n self.delete(m, source)\n }\n\n pub fn delete_http_request_by_id(\n &self,\n id: &str,\n source: &UpdateSource,\n ) -> Result {\n let http_request = self.get_http_request(id)?;\n self.delete_http_request(&http_request, source)\n }\n\n pub fn duplicate_http_request(\n &self,\n http_request: &HttpRequest,\n source: &UpdateSource,\n ) -> Result {\n let mut http_request = http_request.clone();\n http_request.id = \"\".to_string();\n http_request.sort_priority = http_request.sort_priority + 0.001;\n self.upsert(&http_request, source)\n }\n\n pub fn upsert_http_request(\n &self,\n http_request: &HttpRequest,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(http_request, source)\n }\n\n pub fn resolve_auth_for_http_request(\n &self,\n http_request: &HttpRequest,\n ) -> Result<(Option, BTreeMap, String)> {\n if let Some(at) = http_request.authentication_type.clone() {\n return Ok((Some(at), http_request.authentication.clone(), http_request.id.clone()));\n }\n\n if let Some(folder_id) = http_request.folder_id.clone() {\n let folder = self.get_folder(&folder_id)?;\n return self.resolve_auth_for_folder(&folder);\n }\n\n let workspace = self.get_workspace(&http_request.workspace_id)?;\n Ok(self.resolve_auth_for_workspace(&workspace))\n }\n\n pub fn resolve_headers_for_http_request(\n &self,\n http_request: &HttpRequest,\n ) -> Result> {\n // Resolved headers should be from furthest to closest ancestor, to override logically.\n let mut headers = Vec::new();\n\n if let Some(folder_id) = http_request.folder_id.clone() {\n let parent_folder = self.get_folder(&folder_id)?;\n let mut folder_headers = self.resolve_headers_for_folder(&parent_folder)?;\n headers.append(&mut folder_headers);\n } else {\n let workspace = self.get_workspace(&http_request.workspace_id)?;\n let mut workspace_headers = self.resolve_headers_for_workspace(&workspace);\n headers.append(&mut workspace_headers);\n }\n\n headers.append(&mut http_request.headers.clone());\n\n Ok(dedupe_headers(headers))\n }\n\n pub fn list_http_requests_for_folder_recursive(\n &self,\n folder_id: &str,\n ) -> Result> {\n let mut children = Vec::new();\n for m in self.find_many::(FolderIden::FolderId, folder_id, None)? {\n children.extend(self.list_http_requests_for_folder_recursive(&m.id)?);\n }\n for m in self.find_many::(FolderIden::FolderId, folder_id, None)? {\n children.push(m);\n }\n Ok(children)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/http_response_events.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{HttpResponseEvent, HttpResponseEventIden};\nuse crate::util::UpdateSource;\n\nimpl<'a> DbContext<'a> {\n pub fn list_http_response_events(&self, response_id: &str) -> Result> {\n self.find_many(HttpResponseEventIden::ResponseId, response_id, None)\n }\n\n pub fn upsert_http_response_event(\n &self,\n http_response_event: &HttpResponseEvent,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(http_response_event, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/http_responses.rs", "content": "use crate::blob_manager::BlobManager;\nuse crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{HttpResponse, HttpResponseIden, HttpResponseState};\nuse crate::queries::MAX_HISTORY_ITEMS;\nuse crate::util::UpdateSource;\nuse log::{debug, error};\nuse sea_query::{Expr, Query, SqliteQueryBuilder};\nuse sea_query_rusqlite::RusqliteBinder;\nuse std::fs;\n\nimpl<'a> DbContext<'a> {\n pub fn get_http_response(&self, id: &str) -> Result {\n self.find_one(HttpResponseIden::Id, id)\n }\n\n pub fn list_http_responses_for_request(\n &self,\n request_id: &str,\n limit: Option,\n ) -> Result> {\n self.find_many(HttpResponseIden::RequestId, request_id, limit)\n }\n\n pub fn list_http_responses(\n &self,\n workspace_id: &str,\n limit: Option,\n ) -> Result> {\n self.find_many(HttpResponseIden::WorkspaceId, workspace_id, limit)\n }\n\n pub fn delete_all_http_responses_for_request(\n &self,\n request_id: &str,\n source: &UpdateSource,\n ) -> Result<()> {\n let responses = self.list_http_responses_for_request(request_id, None)?;\n for m in responses {\n self.delete(&m, source)?;\n }\n Ok(())\n }\n\n pub fn delete_all_http_responses_for_workspace(\n &self,\n workspace_id: &str,\n source: &UpdateSource,\n ) -> Result<()> {\n let responses =\n self.find_many::(HttpResponseIden::WorkspaceId, workspace_id, None)?;\n for m in responses {\n self.delete(&m, source)?;\n }\n Ok(())\n }\n\n pub fn delete_http_response(\n &self,\n http_response: &HttpResponse,\n source: &UpdateSource,\n blob_manager: &BlobManager,\n ) -> Result {\n // Delete the body file if it exists\n if let Some(p) = http_response.body_path.clone() {\n if let Err(e) = fs::remove_file(p) {\n error!(\"Failed to delete body file: {}\", e);\n };\n }\n\n // Delete request body blobs (pattern: {response_id}.request)\n let blob_ctx = blob_manager.connect();\n let body_id = format!(\"{}.request\", http_response.id);\n if let Err(e) = blob_ctx.delete_chunks(&body_id) {\n error!(\"Failed to delete request body blobs: {}\", e);\n }\n\n Ok(self.delete(http_response, source)?)\n }\n\n pub fn upsert_http_response(\n &self,\n http_response: &HttpResponse,\n source: &UpdateSource,\n blob_manager: &BlobManager,\n ) -> Result {\n let responses = self.list_http_responses_for_request(&http_response.request_id, None)?;\n\n for m in responses.iter().skip(MAX_HISTORY_ITEMS - 1) {\n debug!(\"Deleting old HTTP response {}\", http_response.id);\n self.delete_http_response(&m, source, blob_manager)?;\n }\n\n self.upsert(http_response, source)\n }\n\n pub fn cancel_pending_http_responses(&self) -> Result<()> {\n let closed = serde_json::to_value(&HttpResponseState::Closed)?;\n let (sql, params) = Query::update()\n .table(HttpResponseIden::Table)\n .values([(HttpResponseIden::State, closed.as_str().into())])\n .cond_where(Expr::col(HttpResponseIden::State).ne(closed.as_str()))\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.prepare(sql.as_str())?;\n stmt.execute(&*params.as_params())?;\n Ok(())\n }\n\n pub fn update_http_response_if_id(\n &self,\n response: &HttpResponse,\n source: &UpdateSource,\n ) -> Result {\n if response.id.is_empty() { Ok(response.clone()) } else { self.upsert(response, source) }\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/key_values.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{KeyValue, KeyValueIden, UpsertModelInfo};\nuse crate::util::UpdateSource;\nuse chrono::NaiveDateTime;\nuse log::error;\nuse sea_query::{Asterisk, Cond, Expr, Query, SqliteQueryBuilder};\nuse sea_query_rusqlite::RusqliteBinder;\n\nimpl<'a> DbContext<'a> {\n pub fn list_key_values(&self) -> Result> {\n let (sql, params) = Query::select()\n .from(KeyValueIden::Table)\n .column(Asterisk)\n // Temporary clause to prevent bug when reverting to the previous version, before the\n // ID column was added. A previous version will not know about ID and will create\n // key/value entries that don't have one. This clause ensures they are not queried\n // TODO: Add migration to delete key/values with NULL IDs later on, then remove this\n .cond_where(Expr::col(KeyValueIden::Id).is_not_null())\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.prepare(sql.as_str())?;\n let items = stmt.query_map(&*params.as_params(), KeyValue::from_row)?;\n Ok(items.map(|v| v.unwrap()).collect())\n }\n\n pub fn get_key_value_str(&self, namespace: &str, key: &str, default: &str) -> String {\n match self.get_key_value_raw(namespace, key) {\n None => default.to_string(),\n Some(v) => {\n let result = serde_json::from_str(&v.value);\n match result {\n Ok(v) => v,\n Err(e) => {\n error!(\"Failed to parse string key value: {}\", e);\n default.to_string()\n }\n }\n }\n }\n }\n\n pub fn get_key_value_dte(\n &self,\n namespace: &str,\n key: &str,\n default: NaiveDateTime,\n ) -> NaiveDateTime {\n match self.get_key_value_raw(namespace, key) {\n None => default,\n Some(v) => {\n let result = serde_json::from_str(&v.value);\n match result {\n Ok(v) => v,\n Err(e) => {\n error!(\"Failed to parse date key value: {}\", e);\n default\n }\n }\n }\n }\n }\n\n pub fn get_key_value_int(&self, namespace: &str, key: &str, default: i32) -> i32 {\n match self.get_key_value_raw(namespace, key) {\n None => default.clone(),\n Some(v) => {\n let result = serde_json::from_str(&v.value);\n match result {\n Ok(v) => v,\n Err(e) => {\n error!(\"Failed to parse int key value: {}\", e);\n default.clone()\n }\n }\n }\n }\n }\n\n pub fn get_key_value_raw(&self, namespace: &str, key: &str) -> Option {\n let (sql, params) = Query::select()\n .from(KeyValueIden::Table)\n .column(Asterisk)\n .cond_where(\n Cond::all()\n .add(Expr::col(KeyValueIden::Namespace).eq(namespace))\n .add(Expr::col(KeyValueIden::Key).eq(key)),\n )\n .build_rusqlite(SqliteQueryBuilder);\n self.conn.resolve().query_row(sql.as_str(), &*params.as_params(), KeyValue::from_row).ok()\n }\n\n pub fn set_key_value_dte(\n &self,\n namespace: &str,\n key: &str,\n value: NaiveDateTime,\n source: &UpdateSource,\n ) -> (KeyValue, bool) {\n let encoded = serde_json::to_string(&value).unwrap();\n self.set_key_value_raw(namespace, key, &encoded, source)\n }\n\n pub fn set_key_value_str(\n &self,\n namespace: &str,\n key: &str,\n value: &str,\n source: &UpdateSource,\n ) -> (KeyValue, bool) {\n let encoded = serde_json::to_string(&value).unwrap();\n self.set_key_value_raw(namespace, key, &encoded, source)\n }\n\n pub fn set_key_value_int(\n &self,\n namespace: &str,\n key: &str,\n value: i32,\n source: &UpdateSource,\n ) -> (KeyValue, bool) {\n let encoded = serde_json::to_string(&value).unwrap();\n self.set_key_value_raw(namespace, key, &encoded, source)\n }\n\n pub fn set_key_value_raw(\n &self,\n namespace: &str,\n key: &str,\n value: &str,\n source: &UpdateSource,\n ) -> (KeyValue, bool) {\n match self.get_key_value_raw(namespace, key) {\n None => (\n self.upsert_key_value(\n &KeyValue {\n namespace: namespace.to_string(),\n key: key.to_string(),\n value: value.to_string(),\n ..Default::default()\n },\n source,\n )\n .expect(\"Failed to create key value\"),\n true,\n ),\n Some(kv) => (\n self.upsert_key_value(&KeyValue { value: value.to_string(), ..kv }, source)\n .expect(\"Failed to update key value\"),\n false,\n ),\n }\n }\n\n pub fn upsert_key_value(\n &self,\n key_value: &KeyValue,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(key_value, source)\n }\n\n pub fn delete_key_value(\n &self,\n namespace: &str,\n key: &str,\n source: &UpdateSource,\n ) -> Result<()> {\n let kv = match self.get_key_value_raw(namespace, key) {\n None => return Ok(()),\n Some(m) => m,\n };\n\n self.delete(&kv, source)?;\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/mod.rs", "content": "pub mod any_request;\nmod batch;\nmod cookie_jars;\nmod environments;\nmod folders;\nmod graphql_introspections;\nmod grpc_connections;\nmod grpc_events;\nmod grpc_requests;\nmod http_requests;\nmod http_response_events;\nmod http_responses;\nmod key_values;\nmod model_changes;\nmod plugin_key_values;\nmod plugins;\nmod settings;\nmod sync_states;\nmod websocket_connections;\nmod websocket_events;\nmod websocket_requests;\nmod workspace_metas;\npub mod workspaces;\npub use model_changes::PersistedModelChange;\n\nconst MAX_HISTORY_ITEMS: usize = 20;\n\nuse crate::models::HttpRequestHeader;\nuse std::collections::HashMap;\n\n/// Deduplicate headers by name (case-insensitive), keeping the latest (most specific) value.\n/// Preserves the order of first occurrence for each header name.\npub(crate) fn dedupe_headers(headers: Vec) -> Vec {\n let mut index_by_name: HashMap = HashMap::new();\n let mut deduped: Vec = Vec::new();\n for header in headers {\n let key = header.name.to_lowercase();\n if let Some(&idx) = index_by_name.get(&key) {\n deduped[idx] = header;\n } else {\n index_by_name.insert(key, deduped.len());\n deduped.push(header);\n }\n }\n deduped\n}\n" }, { "path": "crates/yaak-models/src/queries/model_changes.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::util::ModelPayload;\nuse rusqlite::params;\nuse rusqlite::types::Type;\n\n#[derive(Debug, Clone)]\npub struct PersistedModelChange {\n pub id: i64,\n pub created_at: String,\n pub payload: ModelPayload,\n}\n\nimpl<'a> DbContext<'a> {\n pub fn list_model_changes_after(\n &self,\n after_id: i64,\n limit: usize,\n ) -> Result> {\n let mut stmt = self.conn.prepare(\n r#\"\n SELECT id, created_at, payload\n FROM model_changes\n WHERE id > ?1\n ORDER BY id ASC\n LIMIT ?2\n \"#,\n )?;\n\n let items = stmt.query_map(params![after_id, limit as i64], |row| {\n let id: i64 = row.get(0)?;\n let created_at: String = row.get(1)?;\n let payload_raw: String = row.get(2)?;\n let payload = serde_json::from_str::(&payload_raw).map_err(|e| {\n rusqlite::Error::FromSqlConversionFailure(2, Type::Text, Box::new(e))\n })?;\n Ok(PersistedModelChange { id, created_at, payload })\n })?;\n\n Ok(items.collect::, rusqlite::Error>>()?)\n }\n\n pub fn list_model_changes_since(\n &self,\n since_created_at: &str,\n since_id: i64,\n limit: usize,\n ) -> Result> {\n let mut stmt = self.conn.prepare(\n r#\"\n SELECT id, created_at, payload\n FROM model_changes\n WHERE created_at > ?1\n OR (created_at = ?1 AND id > ?2)\n ORDER BY created_at ASC, id ASC\n LIMIT ?3\n \"#,\n )?;\n\n let items = stmt.query_map(params![since_created_at, since_id, limit as i64], |row| {\n let id: i64 = row.get(0)?;\n let created_at: String = row.get(1)?;\n let payload_raw: String = row.get(2)?;\n let payload = serde_json::from_str::(&payload_raw).map_err(|e| {\n rusqlite::Error::FromSqlConversionFailure(2, Type::Text, Box::new(e))\n })?;\n Ok(PersistedModelChange { id, created_at, payload })\n })?;\n\n Ok(items.collect::, rusqlite::Error>>()?)\n }\n\n pub fn prune_model_changes_older_than_days(&self, days: i64) -> Result {\n let offset = format!(\"-{days} days\");\n Ok(self.conn.resolve().execute(\n r#\"\n DELETE FROM model_changes\n WHERE created_at < STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW', ?1)\n \"#,\n params![offset],\n )?)\n }\n\n pub fn prune_model_changes_older_than_hours(&self, hours: i64) -> Result {\n let offset = format!(\"-{hours} hours\");\n Ok(self.conn.resolve().execute(\n r#\"\n DELETE FROM model_changes\n WHERE created_at < STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW', ?1)\n \"#,\n params![offset],\n )?)\n }\n}\n\n#[cfg(test)]\nmod tests {\n use super::*;\n use crate::init_in_memory;\n use crate::models::Workspace;\n use crate::util::{ModelChangeEvent, UpdateSource};\n use serde_json::json;\n\n #[test]\n fn records_model_changes_for_upsert_and_delete() {\n let (query_manager, _blob_manager, _rx) = init_in_memory().expect(\"Failed to init DB\");\n let db = query_manager.connect();\n\n let workspace = db\n .upsert_workspace(\n &Workspace {\n name: \"Changes Test\".to_string(),\n setting_follow_redirects: true,\n setting_validate_certificates: true,\n ..Default::default()\n },\n &UpdateSource::Sync,\n )\n .expect(\"Failed to upsert workspace\");\n\n let created_changes = db.list_model_changes_after(0, 10).expect(\"Failed to list changes\");\n assert_eq!(created_changes.len(), 1);\n assert_eq!(created_changes[0].payload.model.id(), workspace.id);\n assert_eq!(created_changes[0].payload.model.model(), \"workspace\");\n assert!(matches!(\n created_changes[0].payload.change,\n ModelChangeEvent::Upsert { created: true }\n ));\n assert!(matches!(created_changes[0].payload.update_source, UpdateSource::Sync));\n\n db.delete_workspace_by_id(&workspace.id, &UpdateSource::Sync)\n .expect(\"Failed to delete workspace\");\n\n let all_changes = db.list_model_changes_after(0, 10).expect(\"Failed to list changes\");\n assert_eq!(all_changes.len(), 2);\n assert!(matches!(all_changes[1].payload.change, ModelChangeEvent::Delete));\n assert!(all_changes[1].id > all_changes[0].id);\n\n let changes_after_first = db\n .list_model_changes_after(all_changes[0].id, 10)\n .expect(\"Failed to list changes after cursor\");\n assert_eq!(changes_after_first.len(), 1);\n assert!(matches!(changes_after_first[0].payload.change, ModelChangeEvent::Delete));\n }\n\n #[test]\n fn prunes_old_model_changes() {\n let (query_manager, _blob_manager, _rx) = init_in_memory().expect(\"Failed to init DB\");\n let db = query_manager.connect();\n\n db.upsert_workspace(\n &Workspace {\n name: \"Prune Test\".to_string(),\n setting_follow_redirects: true,\n setting_validate_certificates: true,\n ..Default::default()\n },\n &UpdateSource::Sync,\n )\n .expect(\"Failed to upsert workspace\");\n\n let changes = db.list_model_changes_after(0, 10).expect(\"Failed to list changes\");\n assert_eq!(changes.len(), 1);\n\n db.conn\n .resolve()\n .execute(\n \"UPDATE model_changes SET created_at = '2000-01-01 00:00:00.000' WHERE id = ?1\",\n params![changes[0].id],\n )\n .expect(\"Failed to age model change row\");\n\n let pruned =\n db.prune_model_changes_older_than_days(30).expect(\"Failed to prune model changes\");\n assert_eq!(pruned, 1);\n assert!(db.list_model_changes_after(0, 10).expect(\"Failed to list changes\").is_empty());\n }\n\n #[test]\n fn list_model_changes_since_uses_timestamp_with_id_tiebreaker() {\n let (query_manager, _blob_manager, _rx) = init_in_memory().expect(\"Failed to init DB\");\n let db = query_manager.connect();\n\n let workspace = db\n .upsert_workspace(\n &Workspace {\n name: \"Cursor Test\".to_string(),\n setting_follow_redirects: true,\n setting_validate_certificates: true,\n ..Default::default()\n },\n &UpdateSource::Sync,\n )\n .expect(\"Failed to upsert workspace\");\n db.delete_workspace_by_id(&workspace.id, &UpdateSource::Sync)\n .expect(\"Failed to delete workspace\");\n\n let all = db.list_model_changes_after(0, 10).expect(\"Failed to list changes\");\n assert_eq!(all.len(), 2);\n\n let fixed_ts = \"2026-02-16 00:00:00.000\";\n db.conn\n .resolve()\n .execute(\"UPDATE model_changes SET created_at = ?1\", params![fixed_ts])\n .expect(\"Failed to normalize timestamps\");\n\n let after_first =\n db.list_model_changes_since(fixed_ts, all[0].id, 10).expect(\"Failed to query cursor\");\n assert_eq!(after_first.len(), 1);\n assert_eq!(after_first[0].id, all[1].id);\n }\n\n #[test]\n fn prunes_old_model_changes_by_hours() {\n let (query_manager, _blob_manager, _rx) = init_in_memory().expect(\"Failed to init DB\");\n let db = query_manager.connect();\n\n db.upsert_workspace(\n &Workspace {\n name: \"Prune Hour Test\".to_string(),\n setting_follow_redirects: true,\n setting_validate_certificates: true,\n ..Default::default()\n },\n &UpdateSource::Sync,\n )\n .expect(\"Failed to upsert workspace\");\n\n let changes = db.list_model_changes_after(0, 10).expect(\"Failed to list changes\");\n assert_eq!(changes.len(), 1);\n\n db.conn\n .resolve()\n .execute(\n \"UPDATE model_changes SET created_at = STRFTIME('%Y-%m-%d %H:%M:%f', 'NOW', '-2 hours') WHERE id = ?1\",\n params![changes[0].id],\n )\n .expect(\"Failed to age model change row\");\n\n let pruned =\n db.prune_model_changes_older_than_hours(1).expect(\"Failed to prune model changes\");\n assert_eq!(pruned, 1);\n }\n\n #[test]\n fn list_model_changes_deserializes_http_response_event_payload() {\n let (query_manager, _blob_manager, _rx) = init_in_memory().expect(\"Failed to init DB\");\n let db = query_manager.connect();\n\n let payload = json!({\n \"model\": {\n \"model\": \"http_response_event\",\n \"id\": \"re_test\",\n \"createdAt\": \"2026-02-16T21:01:34.809162\",\n \"updatedAt\": \"2026-02-16T21:01:34.809163\",\n \"workspaceId\": \"wk_test\",\n \"responseId\": \"rs_test\",\n \"event\": {\n \"type\": \"info\",\n \"message\": \"hello\"\n }\n },\n \"updateSource\": { \"type\": \"sync\" },\n \"change\": { \"type\": \"upsert\", \"created\": false }\n });\n\n db.conn\n .resolve()\n .execute(\n r#\"\n INSERT INTO model_changes (model, model_id, change, update_source, payload)\n VALUES (?1, ?2, ?3, ?4, ?5)\n \"#,\n params![\n \"http_response_event\",\n \"re_test\",\n r#\"{\"type\":\"upsert\",\"created\":false}\"#,\n r#\"{\"type\":\"sync\"}\"#,\n payload.to_string(),\n ],\n )\n .expect(\"Failed to insert model change row\");\n\n let changes = db.list_model_changes_after(0, 10).expect(\"Failed to list changes\");\n assert_eq!(changes.len(), 1);\n assert_eq!(changes[0].payload.model.model(), \"http_response_event\");\n assert_eq!(changes[0].payload.model.id(), \"re_test\");\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/plugin_key_values.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{PluginKeyValue, PluginKeyValueIden};\nuse sea_query::Keyword::CurrentTimestamp;\nuse sea_query::{Asterisk, Cond, Expr, OnConflict, Query, SqliteQueryBuilder};\nuse sea_query_rusqlite::RusqliteBinder;\n\nimpl<'a> DbContext<'a> {\n pub fn get_plugin_key_value(&self, plugin_name: &str, key: &str) -> Option {\n let (sql, params) = Query::select()\n .from(PluginKeyValueIden::Table)\n .column(Asterisk)\n .cond_where(\n Cond::all()\n .add(Expr::col(PluginKeyValueIden::PluginName).eq(plugin_name))\n .add(Expr::col(PluginKeyValueIden::Key).eq(key)),\n )\n .build_rusqlite(SqliteQueryBuilder);\n self.conn.resolve().query_row(sql.as_str(), &*params.as_params(), |row| row.try_into()).ok()\n }\n\n pub fn set_plugin_key_value(\n &self,\n plugin_name: &str,\n key: &str,\n value: &str,\n ) -> (PluginKeyValue, bool) {\n let existing = self.get_plugin_key_value(plugin_name, key);\n\n let (sql, params) = Query::insert()\n .into_table(PluginKeyValueIden::Table)\n .columns([\n PluginKeyValueIden::CreatedAt,\n PluginKeyValueIden::UpdatedAt,\n PluginKeyValueIden::PluginName,\n PluginKeyValueIden::Key,\n PluginKeyValueIden::Value,\n ])\n .values_panic([\n CurrentTimestamp.into(),\n CurrentTimestamp.into(),\n plugin_name.into(),\n key.into(),\n value.into(),\n ])\n .on_conflict(\n OnConflict::new()\n .update_columns([PluginKeyValueIden::UpdatedAt, PluginKeyValueIden::Value])\n .to_owned(),\n )\n .returning_all()\n .build_rusqlite(SqliteQueryBuilder);\n\n let mut stmt =\n self.conn.prepare(sql.as_str()).expect(\"Failed to prepare PluginKeyValue upsert\");\n let m: PluginKeyValue = stmt\n .query_row(&*params.as_params(), |row| row.try_into())\n .expect(\"Failed to upsert KeyValue\");\n\n (m, existing.is_none())\n }\n\n pub fn delete_plugin_key_value(&self, namespace: &str, key: &str) -> Result {\n if let None = self.get_plugin_key_value(namespace, key) {\n return Ok(false);\n };\n\n let (sql, params) = Query::delete()\n .from_table(PluginKeyValueIden::Table)\n .cond_where(\n Cond::all()\n .add(Expr::col(PluginKeyValueIden::PluginName).eq(namespace))\n .add(Expr::col(PluginKeyValueIden::Key).eq(key)),\n )\n .build_rusqlite(SqliteQueryBuilder);\n self.conn.execute(sql.as_str(), &*params.as_params())?;\n Ok(true)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/plugins.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{Plugin, PluginIden};\nuse crate::util::UpdateSource;\n\nimpl<'a> DbContext<'a> {\n pub fn get_plugin(&self, id: &str) -> Result {\n self.find_one(PluginIden::Id, id)\n }\n\n pub fn get_plugin_by_directory(&self, directory: &str) -> Option {\n self.find_optional(PluginIden::Directory, directory)\n }\n\n pub fn list_plugins(&self) -> Result> {\n self.find_all()\n }\n\n pub fn delete_plugin(&self, plugin: &Plugin, source: &UpdateSource) -> Result {\n self.delete(plugin, source)\n }\n\n pub fn delete_plugin_by_id(&self, id: &str, source: &UpdateSource) -> Result {\n let plugin = self.get_plugin(id)?;\n self.delete_plugin(&plugin, source)\n }\n\n pub fn upsert_plugin(&self, plugin: &Plugin, source: &UpdateSource) -> Result {\n let mut plugin_to_upsert = plugin.clone();\n if let Some(existing) = self.get_plugin_by_directory(&plugin.directory) {\n plugin_to_upsert.id = existing.id;\n }\n self.upsert(&plugin_to_upsert, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/settings.rs", "content": "use std::collections::HashMap;\n\nuse crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{EditorKeymap, Settings, SettingsIden};\nuse crate::util::UpdateSource;\n\nimpl<'a> DbContext<'a> {\n pub fn get_settings(&self) -> Settings {\n let id = \"default\".to_string();\n\n if let Some(s) = self.find_optional::(SettingsIden::Id, &id) {\n return s;\n };\n\n let settings = Settings {\n model: \"settings\".to_string(),\n id,\n created_at: Default::default(),\n updated_at: Default::default(),\n\n appearance: \"system\".to_string(),\n client_certificates: Vec::new(),\n editor_font_size: 12,\n editor_font: None,\n editor_keymap: EditorKeymap::Default,\n editor_soft_wrap: true,\n interface_font_size: 14,\n interface_scale: 1.0,\n interface_font: None,\n hide_window_controls: false,\n use_native_titlebar: false,\n open_workspace_new_window: None,\n proxy: None,\n theme_dark: \"yaak-dark\".to_string(),\n theme_light: \"yaak-light\".to_string(),\n update_channel: \"stable\".to_string(),\n autoupdate: true,\n colored_methods: false,\n hide_license_badge: false,\n auto_download_updates: true,\n check_notifications: true,\n hotkeys: HashMap::new(),\n };\n self.upsert(&settings, &UpdateSource::Background).expect(\"Failed to upsert settings\")\n }\n\n pub fn upsert_settings(&self, settings: &Settings, source: &UpdateSource) -> Result {\n self.upsert(settings, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/sync_states.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{SyncState, SyncStateIden, UpsertModelInfo};\nuse crate::util::UpdateSource;\nuse sea_query::{Asterisk, Cond, Expr, Query, SqliteQueryBuilder};\nuse sea_query_rusqlite::RusqliteBinder;\nuse std::path::Path;\n\nimpl<'a> DbContext<'a> {\n pub fn get_sync_state(&self, id: &str) -> Result {\n self.find_one(SyncStateIden::Id, id)\n }\n\n pub fn upsert_sync_state(&self, sync_state: &SyncState) -> Result {\n self.upsert(sync_state, &UpdateSource::Sync)\n }\n\n pub fn list_sync_states_for_workspace(\n &self,\n workspace_id: &str,\n sync_dir: &Path,\n ) -> Result> {\n let (sql, params) = Query::select()\n .from(SyncStateIden::Table)\n .column(Asterisk)\n .cond_where(\n Cond::all()\n .add(Expr::col(SyncStateIden::WorkspaceId).eq(workspace_id))\n .add(Expr::col(SyncStateIden::SyncDir).eq(sync_dir.to_string_lossy())),\n )\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.prepare(sql.as_str())?;\n let items = stmt.query_map(&*params.as_params(), SyncState::from_row)?;\n Ok(items.map(|v| v.unwrap()).collect())\n }\n\n pub fn delete_sync_state(&self, sync_state: &SyncState) -> Result {\n self.delete(sync_state, &UpdateSource::Sync)\n }\n\n pub fn delete_sync_state_by_id(&self, id: &str) -> Result {\n let sync_state = self.get_sync_state(id)?;\n self.delete_sync_state(&sync_state)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/websocket_connections.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{WebsocketConnection, WebsocketConnectionIden, WebsocketConnectionState};\nuse crate::queries::MAX_HISTORY_ITEMS;\nuse crate::util::UpdateSource;\nuse log::debug;\nuse sea_query::{Expr, Query, SqliteQueryBuilder};\nuse sea_query_rusqlite::RusqliteBinder;\n\nimpl<'a> DbContext<'a> {\n pub fn get_websocket_connection(&self, id: &str) -> Result {\n self.find_one(WebsocketConnectionIden::Id, id)\n }\n\n pub fn delete_all_websocket_connections_for_request(\n &self,\n request_id: &str,\n source: &UpdateSource,\n ) -> Result<()> {\n let responses = self.list_websocket_connections_for_request(request_id)?;\n for m in responses {\n self.delete(&m, source)?;\n }\n Ok(())\n }\n\n pub fn delete_all_websocket_connections_for_workspace(\n &self,\n workspace_id: &str,\n source: &UpdateSource,\n ) -> Result<()> {\n let responses = self.list_websocket_connections(workspace_id)?;\n for m in responses {\n self.delete(&m, source)?;\n }\n Ok(())\n }\n\n pub fn list_websocket_connections(\n &self,\n workspace_id: &str,\n ) -> Result> {\n self.find_many(WebsocketConnectionIden::WorkspaceId, workspace_id, None)\n }\n\n pub fn list_websocket_connections_for_request(\n &self,\n request_id: &str,\n ) -> Result> {\n self.find_many(WebsocketConnectionIden::RequestId, request_id, None)\n }\n\n pub fn delete_websocket_connection(\n &self,\n websocket_connection: &WebsocketConnection,\n source: &UpdateSource,\n ) -> Result {\n self.delete(websocket_connection, source)\n }\n\n pub fn delete_websocket_connection_by_id(\n &self,\n id: &str,\n source: &UpdateSource,\n ) -> Result {\n let websocket_connection = self.get_websocket_connection(id)?;\n self.delete_websocket_connection(&websocket_connection, source)\n }\n\n pub fn upsert_websocket_connection(\n &self,\n websocket_connection: &WebsocketConnection,\n source: &UpdateSource,\n ) -> Result {\n let connections =\n self.list_websocket_connections_for_request(&websocket_connection.request_id)?;\n\n for m in connections.iter().skip(MAX_HISTORY_ITEMS - 1) {\n debug!(\"Deleting old websocket connection {}\", websocket_connection.id);\n self.delete_websocket_connection(&m, source)?;\n }\n\n self.upsert(websocket_connection, source)\n }\n\n pub fn cancel_pending_websocket_connections(&self) -> Result<()> {\n let closed = serde_json::to_value(&WebsocketConnectionState::Closed)?;\n let (sql, params) = Query::update()\n .table(WebsocketConnectionIden::Table)\n .values([(WebsocketConnectionIden::State, closed.as_str().into())])\n .cond_where(Expr::col(WebsocketConnectionIden::State).ne(closed.as_str()))\n .build_rusqlite(SqliteQueryBuilder);\n let mut stmt = self.conn.prepare(sql.as_str())?;\n stmt.execute(&*params.as_params())?;\n Ok(())\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/websocket_events.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{WebsocketEvent, WebsocketEventIden};\nuse crate::util::UpdateSource;\n\nimpl<'a> DbContext<'a> {\n pub fn get_websocket_event(&self, id: &str) -> Result {\n self.find_one(WebsocketEventIden::Id, id)\n }\n\n pub fn list_websocket_events(&self, connection_id: &str) -> Result> {\n self.find_many(WebsocketEventIden::ConnectionId, connection_id, None)\n }\n\n pub fn upsert_websocket_event(\n &self,\n websocket_event: &WebsocketEvent,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(websocket_event, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/websocket_requests.rs", "content": "use super::dedupe_headers;\nuse crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{\n Folder, FolderIden, HttpRequestHeader, WebsocketRequest, WebsocketRequestIden,\n};\nuse crate::util::UpdateSource;\nuse serde_json::Value;\nuse std::collections::BTreeMap;\n\nimpl<'a> DbContext<'a> {\n pub fn get_websocket_request(&self, id: &str) -> Result {\n self.find_one(WebsocketRequestIden::Id, id)\n }\n\n pub fn list_websocket_requests(&self, workspace_id: &str) -> Result> {\n self.find_many(WebsocketRequestIden::WorkspaceId, workspace_id, None)\n }\n\n pub fn list_websocket_requests_for_folder_recursive(\n &self,\n folder_id: &str,\n ) -> Result> {\n let mut children = Vec::new();\n for folder in self.find_many::(FolderIden::FolderId, folder_id, None)? {\n children.extend(self.list_websocket_requests_for_folder_recursive(&folder.id)?);\n }\n for request in\n self.find_many::(WebsocketRequestIden::FolderId, folder_id, None)?\n {\n children.push(request);\n }\n Ok(children)\n }\n\n pub fn delete_websocket_request(\n &self,\n websocket_request: &WebsocketRequest,\n source: &UpdateSource,\n ) -> Result {\n self.delete_all_websocket_connections_for_request(websocket_request.id.as_str(), source)?;\n self.delete(websocket_request, source)\n }\n\n pub fn delete_websocket_request_by_id(\n &self,\n id: &str,\n source: &UpdateSource,\n ) -> Result {\n let request = self.get_websocket_request(id)?;\n self.delete_websocket_request(&request, source)\n }\n\n pub fn duplicate_websocket_request(\n &self,\n websocket_request: &WebsocketRequest,\n source: &UpdateSource,\n ) -> Result {\n let mut websocket_request = websocket_request.clone();\n websocket_request.id = \"\".to_string();\n websocket_request.sort_priority = websocket_request.sort_priority + 0.001;\n self.upsert(&websocket_request, source)\n }\n\n pub fn upsert_websocket_request(\n &self,\n websocket_request: &WebsocketRequest,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(websocket_request, source)\n }\n\n pub fn resolve_auth_for_websocket_request(\n &self,\n websocket_request: &WebsocketRequest,\n ) -> Result<(Option, BTreeMap, String)> {\n if let Some(at) = websocket_request.authentication_type.clone() {\n return Ok((\n Some(at),\n websocket_request.authentication.clone(),\n websocket_request.id.clone(),\n ));\n }\n\n if let Some(folder_id) = websocket_request.folder_id.clone() {\n let folder = self.get_folder(&folder_id)?;\n return self.resolve_auth_for_folder(&folder);\n }\n\n let workspace = self.get_workspace(&websocket_request.workspace_id)?;\n Ok(self.resolve_auth_for_workspace(&workspace))\n }\n\n pub fn resolve_headers_for_websocket_request(\n &self,\n websocket_request: &WebsocketRequest,\n ) -> Result> {\n let workspace = self.get_workspace(&websocket_request.workspace_id)?;\n\n // Resolved headers should be from furthest to closest ancestor, to override logically.\n let mut headers = Vec::new();\n\n headers.append(&mut workspace.headers.clone());\n\n if let Some(folder_id) = websocket_request.folder_id.clone() {\n let parent_folder = self.get_folder(&folder_id)?;\n let mut folder_headers = self.resolve_headers_for_folder(&parent_folder)?;\n headers.append(&mut folder_headers);\n } else {\n let workspace = self.get_workspace(&websocket_request.workspace_id)?;\n let mut workspace_headers = self.resolve_headers_for_workspace(&workspace);\n headers.append(&mut workspace_headers);\n }\n\n headers.append(&mut websocket_request.headers.clone());\n\n Ok(dedupe_headers(headers))\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/workspace_metas.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{WorkspaceMeta, WorkspaceMetaIden};\nuse crate::util::UpdateSource;\nuse log::info;\n\nimpl<'a> DbContext<'a> {\n pub fn get_workspace_meta(&self, workspace_id: &str) -> Option {\n self.find_optional(WorkspaceMetaIden::WorkspaceId, workspace_id)\n }\n\n pub fn list_workspace_metas(&self, workspace_id: &str) -> Result> {\n let mut workspace_metas =\n self.find_many(WorkspaceMetaIden::WorkspaceId, workspace_id, None)?;\n\n if workspace_metas.is_empty() {\n let wm = WorkspaceMeta { workspace_id: workspace_id.to_string(), ..Default::default() };\n workspace_metas.push(self.upsert_workspace_meta(&wm, &UpdateSource::Background)?)\n }\n\n Ok(workspace_metas)\n }\n\n pub fn get_or_create_workspace_meta(&self, workspace_id: &str) -> Result {\n let workspace_meta = self.get_workspace_meta(workspace_id);\n if let Some(workspace_meta) = workspace_meta {\n return Ok(workspace_meta);\n }\n\n let workspace_meta =\n WorkspaceMeta { workspace_id: workspace_id.to_string(), ..Default::default() };\n\n info!(\"Creating WorkspaceMeta for {workspace_id}\");\n\n self.upsert_workspace_meta(&workspace_meta, &UpdateSource::Background)\n }\n\n pub fn upsert_workspace_meta(\n &self,\n workspace_meta: &WorkspaceMeta,\n source: &UpdateSource,\n ) -> Result {\n self.upsert(workspace_meta, source)\n }\n}\n" }, { "path": "crates/yaak-models/src/queries/workspaces.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{\n EnvironmentIden, FolderIden, GrpcRequestIden, HttpRequestHeader, HttpRequestIden,\n WebsocketRequestIden, Workspace, WorkspaceIden,\n};\nuse crate::util::UpdateSource;\nuse serde_json::Value;\nuse std::collections::BTreeMap;\n\nimpl<'a> DbContext<'a> {\n pub fn get_workspace(&self, id: &str) -> Result {\n self.find_one(WorkspaceIden::Id, id)\n }\n\n pub fn list_workspaces(&self) -> Result> {\n let mut workspaces = self.find_all()?;\n\n if workspaces.is_empty() {\n workspaces.push(self.upsert_workspace(\n &Workspace {\n name: \"Yaak\".to_string(),\n setting_follow_redirects: true,\n setting_validate_certificates: true,\n ..Default::default()\n },\n &UpdateSource::Background,\n )?)\n }\n\n Ok(workspaces)\n }\n\n pub fn delete_workspace(\n &self,\n workspace: &Workspace,\n source: &UpdateSource,\n ) -> Result {\n for m in self.find_many(HttpRequestIden::WorkspaceId, &workspace.id, None)? {\n self.delete_http_request(&m, source)?;\n }\n\n for m in self.find_many(GrpcRequestIden::WorkspaceId, &workspace.id, None)? {\n self.delete_grpc_request(&m, source)?;\n }\n\n for m in self.find_many(WebsocketRequestIden::FolderId, &workspace.id, None)? {\n self.delete_websocket_request(&m, source)?;\n }\n\n for m in self.find_many(FolderIden::WorkspaceId, &workspace.id, None)? {\n self.delete_folder(&m, source)?;\n }\n\n for m in self.find_many(EnvironmentIden::WorkspaceId, &workspace.id, None)? {\n self.delete_environment(&m, source)?;\n }\n\n self.delete(workspace, source)\n }\n\n pub fn delete_workspace_by_id(&self, id: &str, source: &UpdateSource) -> Result {\n let workspace = self.get_workspace(id)?;\n self.delete_workspace(&workspace, source)\n }\n\n pub fn upsert_workspace(&self, w: &Workspace, source: &UpdateSource) -> Result {\n self.upsert(w, source)\n }\n\n pub fn resolve_auth_for_workspace(\n &self,\n workspace: &Workspace,\n ) -> (Option, BTreeMap, String) {\n (\n workspace.authentication_type.clone(),\n workspace.authentication.clone(),\n workspace.id.clone(),\n )\n }\n\n pub fn resolve_headers_for_workspace(&self, workspace: &Workspace) -> Vec {\n let mut headers = default_headers();\n headers.extend(workspace.headers.clone());\n headers\n }\n}\n\n/// Global default headers that are always sent with requests unless overridden.\n/// These are prepended to the inheritance chain so workspace/folder/request headers\n/// can override or disable them.\npub fn default_headers() -> Vec {\n vec![\n HttpRequestHeader {\n enabled: true,\n name: \"User-Agent\".to_string(),\n value: \"yaak\".to_string(),\n id: None,\n },\n HttpRequestHeader {\n enabled: true,\n name: \"Accept\".to_string(),\n value: \"*/*\".to_string(),\n id: None,\n },\n ]\n}\n" }, { "path": "crates/yaak-models/src/query_manager.rs", "content": "use crate::connection_or_tx::ConnectionOrTx;\nuse crate::db_context::DbContext;\nuse crate::error::Error::GenericError;\nuse crate::util::ModelPayload;\nuse r2d2::Pool;\nuse r2d2_sqlite::SqliteConnectionManager;\nuse rusqlite::TransactionBehavior;\nuse std::sync::{Arc, Mutex, mpsc};\n\n#[derive(Debug, Clone)]\npub struct QueryManager {\n pool: Arc>>,\n events_tx: mpsc::Sender,\n}\n\nimpl QueryManager {\n pub fn new(pool: Pool, events_tx: mpsc::Sender) -> Self {\n QueryManager { pool: Arc::new(Mutex::new(pool)), events_tx }\n }\n\n pub fn connect(&self) -> DbContext<'_> {\n let conn = self\n .pool\n .lock()\n .expect(\"Failed to gain lock on DB\")\n .get()\n .expect(\"Failed to get a new DB connection from the pool\");\n DbContext { _events_tx: self.events_tx.clone(), conn: ConnectionOrTx::Connection(conn) }\n }\n\n pub fn with_conn(&self, func: F) -> T\n where\n F: FnOnce(&DbContext) -> T,\n {\n let conn = self\n .pool\n .lock()\n .expect(\"Failed to gain lock on DB for transaction\")\n .get()\n .expect(\"Failed to get new DB connection from the pool\");\n\n let db_context = DbContext {\n _events_tx: self.events_tx.clone(),\n conn: ConnectionOrTx::Connection(conn),\n };\n\n func(&db_context)\n }\n\n pub fn with_tx(\n &self,\n func: impl FnOnce(&DbContext) -> std::result::Result,\n ) -> std::result::Result\n where\n E: From,\n {\n let mut conn = self\n .pool\n .lock()\n .expect(\"Failed to gain lock on DB for transaction\")\n .get()\n .expect(\"Failed to get new DB connection from the pool\");\n let tx = conn\n .transaction_with_behavior(TransactionBehavior::Immediate)\n .expect(\"Failed to start DB transaction\");\n\n let db_context = DbContext {\n _events_tx: self.events_tx.clone(),\n conn: ConnectionOrTx::Transaction(&tx),\n };\n\n match func(&db_context) {\n Ok(val) => {\n tx.commit()\n .map_err(|e| GenericError(format!(\"Failed to commit transaction {e:?}\")))?;\n Ok(val)\n }\n Err(e) => {\n tx.rollback()\n .map_err(|e| GenericError(format!(\"Failed to rollback transaction {e:?}\")))?;\n Err(e)\n }\n }\n }\n}\n" }, { "path": "crates/yaak-models/src/render.rs", "content": "use crate::models::{Environment, EnvironmentVariable};\nuse std::collections::HashMap;\n\npub fn make_vars_hashmap(environment_chain: Vec) -> HashMap {\n let mut variables = HashMap::new();\n\n for e in environment_chain.iter().rev() {\n variables = add_variable_to_map(variables, &e.variables);\n }\n\n variables\n}\n\nfn add_variable_to_map(\n m: HashMap,\n variables: &Vec,\n) -> HashMap {\n let mut map = m.clone();\n for variable in variables {\n if !variable.enabled {\n continue;\n }\n let name = variable.name.as_str();\n let value = variable.value.as_str();\n map.insert(name.into(), value.into());\n }\n\n map\n}\n" }, { "path": "crates/yaak-models/src/util.rs", "content": "use crate::db_context::DbContext;\nuse crate::error::Result;\nuse crate::models::{\n AnyModel, Environment, Folder, GrpcRequest, HttpRequest, UpsertModelInfo, WebsocketRequest,\n Workspace, WorkspaceIden,\n};\nuse chrono::{NaiveDateTime, Utc};\nuse nanoid::nanoid;\nuse serde::{Deserialize, Serialize};\nuse std::collections::BTreeMap;\nuse ts_rs::TS;\nuse yaak_core::WorkspaceContext;\n\npub fn generate_prefixed_id(prefix: &str) -> String {\n format!(\"{prefix}_{}\", generate_id())\n}\n\npub fn generate_id() -> String {\n generate_id_of_length(10)\n}\n\npub fn generate_id_of_length(n: usize) -> String {\n let alphabet: [char; 57] = [\n '2', '3', '4', '5', '6', '7', '8', '9', 'a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j',\n 'k', 'm', 'n', 'o', 'p', 'q', 'r', 's', 't', 'u', 'v', 'w', 'x', 'y', 'z', 'A', 'B', 'C',\n 'D', 'E', 'F', 'G', 'H', 'J', 'K', 'L', 'M', 'N', 'P', 'Q', 'R', 'S', 'T', 'U', 'V', 'W',\n 'X', 'Y', 'Z',\n ];\n\n nanoid!(n, &alphabet)\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub struct ModelPayload {\n pub model: AnyModel,\n pub update_source: UpdateSource,\n pub change: ModelChangeEvent,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\", tag = \"type\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum ModelChangeEvent {\n Upsert { created: bool },\n Delete,\n}\n\n#[derive(Debug, Clone, Serialize, Deserialize, TS)]\n#[serde(rename_all = \"snake_case\", tag = \"type\")]\n#[ts(export, export_to = \"gen_models.ts\")]\npub enum UpdateSource {\n Background,\n Import,\n Plugin,\n Sync,\n Window { label: String },\n}\n\nimpl UpdateSource {\n pub fn from_window_label(label: impl Into) -> Self {\n Self::Window { label: label.into() }\n }\n}\n\n#[derive(Default, Debug, Deserialize, Serialize)]\n#[serde(default, rename_all = \"camelCase\")]\npub struct WorkspaceExport {\n pub yaak_version: String,\n pub yaak_schema: i64,\n pub timestamp: NaiveDateTime,\n pub resources: BatchUpsertResult,\n}\n\n#[derive(Default, Debug, Deserialize, Serialize, TS)]\n#[serde(default, rename_all = \"camelCase\")]\n#[ts(export, export_to = \"gen_util.ts\")]\npub struct BatchUpsertResult {\n pub workspaces: Vec,\n pub environments: Vec,\n pub folders: Vec,\n pub http_requests: Vec,\n pub grpc_requests: Vec,\n pub websocket_requests: Vec,\n}\n\npub fn get_workspace_export_resources(\n db: &DbContext,\n yaak_version: &str,\n workspace_ids: Vec<&str>,\n include_private_environments: bool,\n) -> Result {\n let mut data = WorkspaceExport {\n yaak_version: yaak_version.to_string(),\n yaak_schema: 4,\n timestamp: Utc::now().naive_utc(),\n resources: BatchUpsertResult {\n workspaces: Vec::new(),\n environments: Vec::new(),\n folders: Vec::new(),\n http_requests: Vec::new(),\n grpc_requests: Vec::new(),\n websocket_requests: Vec::new(),\n },\n };\n\n for workspace_id in workspace_ids {\n data.resources.workspaces.push(db.find_one(WorkspaceIden::Id, workspace_id)?);\n data.resources.environments.append(\n &mut db\n .list_environments_ensure_base(workspace_id)?\n .into_iter()\n .filter(|e| include_private_environments || e.public)\n .collect(),\n );\n data.resources.folders.append(&mut db.list_folders(workspace_id)?);\n data.resources.http_requests.append(&mut db.list_http_requests(workspace_id)?);\n data.resources.grpc_requests.append(&mut db.list_grpc_requests(workspace_id)?);\n data.resources.websocket_requests.append(&mut db.list_websocket_requests(workspace_id)?);\n }\n\n Ok(data)\n}\n\npub fn maybe_gen_id(\n ctx: &WorkspaceContext,\n id: &str,\n ids: &mut BTreeMap,\n) -> String {\n if id == \"CURRENT_WORKSPACE\" {\n if let Some(wid) = &ctx.workspace_id {\n return wid.to_string();\n }\n }\n\n if !id.starts_with(\"GENERATE_ID::\") {\n return id.to_string();\n }\n\n let unique_key = id.replace(\"GENERATE_ID\", \"\");\n if let Some(existing) = ids.get(unique_key.as_str()) {\n existing.to_string()\n } else {\n let new_id = M::generate_id();\n ids.insert(unique_key, new_id.clone());\n new_id\n }\n}\n\npub fn maybe_gen_id_opt(\n ctx: &WorkspaceContext,\n id: Option,\n ids: &mut BTreeMap,\n) -> Option {\n match id {\n Some(id) => Some(maybe_gen_id::(ctx, id.as_str(), ids)),\n None => None,\n }\n}\n" }, { "path": "crates/yaak-plugins/Cargo.toml", "content": "[package]\nname = \"yaak-plugins\"\nversion = \"0.1.0\"\nedition = \"2024\"\npublish = false\n\n[dependencies]\nbase64 = \"0.22.1\"\nchrono = { workspace = true }\ndunce = \"1.0.4\"\nfutures-util = \"0.3.30\"\nhex = { workspace = true }\nkeyring = { workspace = true, features = [\"apple-native\", \"windows-native\", \"sync-secret-service\"] }\nlog = { workspace = true }\nmd5 = \"0.7.0\"\npath-slash = \"0.2.1\"\nrand = \"0.9.0\"\nreqwest = { workspace = true, features = [\"json\"] }\nserde = { workspace = true, features = [\"derive\"] }\nserde_json = { workspace = true }\nsha2 = { workspace = true }\nthiserror = { workspace = true }\ntokio = { workspace = true, features = [\"macros\", \"rt-multi-thread\", \"process\", \"fs\"] }\ntokio-tungstenite = \"0.26.1\"\nts-rs = { workspace = true }\nyaak-common = { workspace = true }\nyaak-crypto = { workspace = true }\nyaak-models = { workspace = true }\nyaak-templates = { workspace = true }\nzip-extract = \"0.4.0\"\n" }, { "path": "crates/yaak-plugins/bindings/gen_api.ts", "content": "// This file was generated by [ts-rs](https://github.com/Aleph-Alpha/ts-rs). Do not edit this file manually.\nimport type { PluginVersion } from \"./gen_search\";\n\nexport type PluginNameVersion = { name: string, version: string, };\n\nexport type PluginSearchResponse = { plugins: Array, };\n\nexport type PluginUpdatesResponse = { plugins: Array, };\n" }, { "path": "crates/yaak-plugins/bindings/gen_events.ts", "content": "// This file was generated by [ts-rs](https://github.com/Aleph-Alpha/ts-rs). Do not edit this file manually.\nimport type { AnyModel, Environment, Folder, GrpcRequest, HttpRequest, HttpResponse, WebsocketRequest, Workspace } from \"./gen_models\";\nimport type { JsonValue } from \"./serde_json/JsonValue\";\n\nexport type BootRequest = { dir: string, watch: boolean, };\n\nexport type CallFolderActionArgs = { folder: Folder, };\n\nexport type CallFolderActionRequest = { index: number, pluginRefId: string, args: CallFolderActionArgs, };\n\nexport type CallGrpcRequestActionArgs = { grpcRequest: GrpcRequest, protoFiles: Array, };\n\nexport type CallGrpcRequestActionRequest = { index: number, pluginRefId: string, args: CallGrpcRequestActionArgs, };\n\nexport type CallHttpAuthenticationActionArgs = { contextId: string, values: { [key in string]?: JsonPrimitive }, };\n\nexport type CallHttpAuthenticationActionRequest = { index: number, pluginRefId: string, args: CallHttpAuthenticationActionArgs, };\n\nexport type CallHttpAuthenticationRequest = { contextId: string, values: { [key in string]?: JsonPrimitive }, method: string, url: string, headers: Array, };\n\nexport type CallHttpAuthenticationResponse = {\n/**\n * HTTP headers to add to the request. Existing headers will be replaced, while\n * new headers will be added.\n */\nsetHeaders?: Array,\n/**\n * Query parameters to add to the request. Existing params will be replaced, while\n * new params will be added.\n */\nsetQueryParameters?: Array, };\n\nexport type CallHttpRequestActionArgs = { httpRequest: HttpRequest, };\n\nexport type CallHttpRequestActionRequest = { index: number, pluginRefId: string, args: CallHttpRequestActionArgs, };\n\nexport type CallTemplateFunctionArgs = { purpose: RenderPurpose, values: { [key in string]?: JsonPrimitive }, };\n\nexport type CallTemplateFunctionRequest = { name: string, args: CallTemplateFunctionArgs, };\n\nexport type CallTemplateFunctionResponse = { value: string | null, error?: string, };\n\nexport type CallWebsocketRequestActionArgs = { websocketRequest: WebsocketRequest, };\n\nexport type CallWebsocketRequestActionRequest = { index: number, pluginRefId: string, args: CallWebsocketRequestActionArgs, };\n\nexport type CallWorkspaceActionArgs = { workspace: Workspace, };\n\nexport type CallWorkspaceActionRequest = { index: number, pluginRefId: string, args: CallWorkspaceActionArgs, };\n\nexport type CloseWindowRequest = { label: string, };\n\nexport type Color = \"primary\" | \"secondary\" | \"info\" | \"success\" | \"notice\" | \"warning\" | \"danger\";\n\nexport type CompletionOptionType = \"constant\" | \"variable\";\n\nexport type Content = { \"type\": \"text\", content: string, } | { \"type\": \"markdown\", content: string, };\n\nexport type CopyTextRequest = { text: string, };\n\nexport type DeleteKeyValueRequest = { key: string, };\n\nexport type DeleteKeyValueResponse = { deleted: boolean, };\n\nexport type DeleteModelRequest = { model: string, id: string, };\n\nexport type DeleteModelResponse = { model: AnyModel, };\n\nexport type DialogSize = \"sm\" | \"md\" | \"lg\" | \"full\" | \"dynamic\";\n\nexport type EditorLanguage = \"text\" | \"javascript\" | \"json\" | \"html\" | \"xml\" | \"graphql\" | \"markdown\" | \"c\" | \"clojure\" | \"csharp\" | \"go\" | \"http\" | \"java\" | \"kotlin\" | \"objective_c\" | \"ocaml\" | \"php\" | \"powershell\" | \"python\" | \"r\" | \"ruby\" | \"shell\" | \"swift\";\n\nexport type EmptyPayload = {};\n\nexport type ErrorResponse = { error: string, };\n\nexport type ExportHttpRequestRequest = { httpRequest: HttpRequest, };\n\nexport type ExportHttpRequestResponse = { content: string, };\n\nexport type FileFilter = { name: string,\n/**\n * File extensions to require\n */\nextensions: Array, };\n\nexport type FilterRequest = { content: string, filter: string, };\n\nexport type FilterResponse = { content: string, error?: string, };\n\nexport type FindHttpResponsesRequest = { requestId: string, limit?: number, };\n\nexport type FindHttpResponsesResponse = { httpResponses: Array, };\n\nexport type FolderAction = { label: string, icon?: Icon, };\n\nexport type FormInput = { \"type\": \"text\" } & FormInputText | { \"type\": \"editor\" } & FormInputEditor | { \"type\": \"select\" } & FormInputSelect | { \"type\": \"checkbox\" } & FormInputCheckbox | { \"type\": \"file\" } & FormInputFile | { \"type\": \"http_request\" } & FormInputHttpRequest | { \"type\": \"accordion\" } & FormInputAccordion | { \"type\": \"h_stack\" } & FormInputHStack | { \"type\": \"banner\" } & FormInputBanner | { \"type\": \"markdown\" } & FormInputMarkdown | { \"type\": \"key_value\" } & FormInputKeyValue;\n\nexport type FormInputAccordion = { label: string, inputs?: Array, hidden?: boolean, };\n\nexport type FormInputBanner = { inputs?: Array, hidden?: boolean, color?: Color, };\n\nexport type FormInputBase = {\n/**\n * The name of the input. The value will be stored at this object attribute in the resulting data\n */\nname: string,\n/**\n * Whether this input is visible for the given configuration. Use this to\n * make branching forms.\n */\nhidden?: boolean,\n/**\n * Whether the user must fill in the argument\n */\noptional?: boolean,\n/**\n * The label of the input\n */\nlabel?: string,\n/**\n * Visually hide the label of the input\n */\nhideLabel?: boolean,\n/**\n * The default value\n */\ndefaultValue?: string, disabled?: boolean,\n/**\n * Longer description of the input, likely shown in a tooltip\n */\ndescription?: string, };\n\nexport type FormInputCheckbox = {\n/**\n * The name of the input. The value will be stored at this object attribute in the resulting data\n */\nname: string,\n/**\n * Whether this input is visible for the given configuration. Use this to\n * make branching forms.\n */\nhidden?: boolean,\n/**\n * Whether the user must fill in the argument\n */\noptional?: boolean,\n/**\n * The label of the input\n */\nlabel?: string,\n/**\n * Visually hide the label of the input\n */\nhideLabel?: boolean,\n/**\n * The default value\n */\ndefaultValue?: string, disabled?: boolean,\n/**\n * Longer description of the input, likely shown in a tooltip\n */\ndescription?: string, };\n\nexport type FormInputEditor = {\n/**\n * Placeholder for the text input\n */\nplaceholder?: string | null,\n/**\n * Don't show the editor gutter (line numbers, folds, etc.)\n */\nhideGutter?: boolean,\n/**\n * Language for syntax highlighting\n */\nlanguage?: EditorLanguage, readOnly?: boolean,\n/**\n * Fixed number of visible rows\n */\nrows?: number, completionOptions?: Array,\n/**\n * The name of the input. The value will be stored at this object attribute in the resulting data\n */\nname: string,\n/**\n * Whether this input is visible for the given configuration. Use this to\n * make branching forms.\n */\nhidden?: boolean,\n/**\n * Whether the user must fill in the argument\n */\noptional?: boolean,\n/**\n * The label of the input\n */\nlabel?: string,\n/**\n * Visually hide the label of the input\n */\nhideLabel?: boolean,\n/**\n * The default value\n */\ndefaultValue?: string, disabled?: boolean,\n/**\n * Longer description of the input, likely shown in a tooltip\n */\ndescription?: string, };\n\nexport type FormInputFile = {\n/**\n * The title of the file selection window\n */\ntitle: string,\n/**\n * Allow selecting multiple files\n */\nmultiple?: boolean, directory?: boolean, defaultPath?: string, filters?: Array,\n/**\n * The name of the input. The value will be stored at this object attribute in the resulting data\n */\nname: string,\n/**\n * Whether this input is visible for the given configuration. Use this to\n * make branching forms.\n */\nhidden?: boolean,\n/**\n * Whether the user must fill in the argument\n */\noptional?: boolean,\n/**\n * The label of the input\n */\nlabel?: string,\n/**\n * Visually hide the label of the input\n */\nhideLabel?: boolean,\n/**\n * The default value\n */\ndefaultValue?: string, disabled?: boolean,\n/**\n * Longer description of the input, likely shown in a tooltip\n */\ndescription?: string, };\n\nexport type FormInputHStack = { inputs?: Array, hidden?: boolean, };\n\nexport type FormInputHttpRequest = {\n/**\n * The name of the input. The value will be stored at this object attribute in the resulting data\n */\nname: string,\n/**\n * Whether this input is visible for the given configuration. Use this to\n * make branching forms.\n */\nhidden?: boolean,\n/**\n * Whether the user must fill in the argument\n */\noptional?: boolean,\n/**\n * The label of the input\n */\nlabel?: string,\n/**\n * Visually hide the label of the input\n */\nhideLabel?: boolean,\n/**\n * The default value\n */\ndefaultValue?: string, disabled?: boolean,\n/**\n * Longer description of the input, likely shown in a tooltip\n */\ndescription?: string, };\n\nexport type FormInputKeyValue = {\n/**\n * The name of the input. The value will be stored at this object attribute in the resulting data\n */\nname: string,\n/**\n * Whether this input is visible for the given configuration. Use this to\n * make branching forms.\n */\nhidden?: boolean,\n/**\n * Whether the user must fill in the argument\n */\noptional?: boolean,\n/**\n * The label of the input\n */\nlabel?: string,\n/**\n * Visually hide the label of the input\n */\nhideLabel?: boolean,\n/**\n * The default value\n */\ndefaultValue?: string, disabled?: boolean,\n/**\n * Longer description of the input, likely shown in a tooltip\n */\ndescription?: string, };\n\nexport type FormInputMarkdown = { content: string, hidden?: boolean, };\n\nexport type FormInputSelect = {\n/**\n * The options that will be available in the select input\n */\noptions: Array,\n/**\n * The name of the input. The value will be stored at this object attribute in the resulting data\n */\nname: string,\n/**\n * Whether this input is visible for the given configuration. Use this to\n * make branching forms.\n */\nhidden?: boolean,\n/**\n * Whether the user must fill in the argument\n */\noptional?: boolean,\n/**\n * The label of the input\n */\nlabel?: string,\n/**\n * Visually hide the label of the input\n */\nhideLabel?: boolean,\n/**\n * The default value\n */\ndefaultValue?: string, disabled?: boolean,\n/**\n * Longer description of the input, likely shown in a tooltip\n */\ndescription?: string, };\n\nexport type FormInputSelectOption = { label: string, value: string, };\n\nexport type FormInputText = {\n/**\n * Placeholder for the text input\n */\nplaceholder?: string | null,\n/**\n * Placeholder for the text input\n */\npassword?: boolean,\n/**\n * Whether to allow newlines in the input, like a