Skip to content

Config search does not look inside rows[].configuration #196

Description

@ondrej-lorenc

Context

Discovered while auditing 14 Keboola projects for a single question: "Which Snowflake writers are active, part of a scheduled flow, and load a source table larger than 1 GB in full-load mode?" The audit should be answerable end-to-end from the CLI / MCP tools, but several gaps forced manual workarounds. This issue covers one of them; the audit uncovered three more, filed separately.

Problem

kbagent config search --component-id <id> --query <text> searches the main configuration object, but not rows[].configuration. For components that store their real per-item configuration in rows (Snowflake/MySQL/PostgreSQL/BigQuery writers, DB extractors, Google Sheets, many storage components), this makes search unusable for the most common questions.

Steps to reproduce

# There are Snowflake writer rows with "incremental": false in their row config.
kbagent --json config search --component-id keboola.wr-db-snowflake --query '"incremental": false'
# -> 0 matches

# Verified by pulling a detail:
kbagent --json config detail --project kosik-core \
  --component-id keboola.wr-db-snowflake \
  --config-id 01kagw8j78rkj7jt8pn66rjhy7
# rows[0].configuration.parameters.incremental == false exists.

Workaround used

Downloaded config detail for all 102 Snowflake writer configs via a parallel shell script and parsed rows[].configuration.parameters locally.

Use case

Any audit that needs to answer "which writer rows use full load?", "which extractor rows use incremental fetching?", "which rows reference table X?", "which rows have a specific SSH tunnel hostname?" — today all of these require downloading every config and parsing offline.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions