Data control plane · Open Core development

Define the data product. NextState builds and operates it safely.

Data teams usually describe the result they need and then engineer loaders, transformations, schedules, checks, retries, publication scripts, and recovery procedures to keep it working. NextState—a temporary working name—separates that desired product from the operational machinery.

Current boundary: a working private trusted-local baseline with bounded development proofs. It is not yet a public release, hosted service, or broadly supported production platform.

Where it fits

Assessment explains the inherited estate. A data control plane governs what replaces it.

The consulting practice connects these ideas through architecture judgment, sequencing, and adoption. The named products support the concepts; they are not the concepts themselves.

01

Modernization assessment

Understand the inherited estate.

Inventory, dependency evidence, complexity signals, and confidence gaps make the current state more reviewable before target decisions.

Explore assessments and TangleMap
02

Data control plane

Operate the declared product.

Definition, planning, candidate creation, verification, publication, evidence, and recovery become one explicit operating path.

Current project name: NextState

03

Advisory work

Choose and sequence the boundary.

Architecture and delivery judgment still determine what should be standardized, what should remain custom, and what the organization can safely adopt.

Discuss the architecture

A concrete example

Define the result and the rules it must obey.

Instead of scattering meaning, quality, freshness, publication, and recovery decisions across tickets and pipeline code, declare the important conditions once and make every later step inspectable against them.

Example product contract

Daily customer order summary

Meaning
Daily order value by customer and market
Grain
One row per customer, market, and business date
Quality
Required keys, bounded totals, and explicit late-data policy
Freshness
Published after the daily source window closes
Recovery
Retain the prior valid publication and replay evidence

Inspectable before execution

A completed job is not automatically a correct data product.

The plan shows what should change and what is affected. A runtime builds a hidden candidate; NextState verifies the observed result and changes what consumers see only when the evidence is acceptable.

If an amount is invalid, revenue may become uncertain while independently evidenced units remain usable. The control plane should explain that consequence instead of treating the whole job as simply passed or failed.

01 Define Product contract
02 Plan Affected scope
03 Build Hidden candidate
04 Verify Evidence and consequences
05 Publish Controlled visibility
06 Recover Last-known-good

Current project boundary

Working private evidence, without turning development proofs into support claims.

The website summarizes the current shape without becoming a second capability matrix. Exact release identity, runtime status, evaluator instructions, and limitations belong with the technical project rather than being copied here.

Working lifecycle

Trusted-local baseline

The current artifact exercises a declarative product lifecycle with exact local artifacts. Separate consumer tests validate published outputs against agreed contract expectations.

Development evidence

Bounded runtime proofs

Local runtime and Test Lab work provide evidence at specific boundaries. They are not the same as installed, supported, or certified product integrations.

Current availability

Not yet a public release

The project is not yet a broadly supported production platform. Public packaging, evaluator readiness, and exact limitations remain with the technical project.

Explicit limits

What this project does not currently claim

  • No hosted service, shared team administration, authentication/RBAC product, stable public HTTP API, web UI, distributed workers, or HA claim.
  • No broadly supported managed-runtime, continuous-streaming, broad connector-lifecycle, or external orchestration claim.
  • No claim that the framework replaces SQL, Python, dbt, Airflow, Dagster, Databricks, or domain expertise.

From assessment to operation

Decide where a control boundary would make the next platform safer.

If the challenge is repeated bespoke pipeline work, unclear publication rules, or fragile recovery, the next step is to identify one product contract and test where an explicit control plane would help. NextState remains a temporary working name; the consulting decision does not depend on that name lasting.