← All posts

July 15, 20264 min read

What "trainable AI" should mean after an open-source starting point

A model does not become meaningfully trainable because a website says it learns. The data, weights, method, licence and evaluation all matter.

"Our AI learns your business" is one of the easiest claims to make and one of the hardest to interpret.

It might mean the system remembers a few preferences. It might retrieve company documents at answer time. It might train a small adapter. It might update the model's weights through fine-tuning or continued pre-training. Those are not interchangeable techniques, and they do not create the same cost, risk or ownership.

Kvantim LLM is our classic transformer direction: a model rebuilt from an open-source model base and intended for further training and specialisation. For that statement to be useful, we need to say what changes after the starting point.

The base model is the beginning, not an invisible detail

Starting from an open-source model can reduce the cost and time required to build useful language-model capability. It also creates obligations.

The base must be named. Its version and licence must be recorded. The company must know whether the intended training, distribution, hosted service and commercial use comply with that licence. If the upstream model has use restrictions or attribution requirements, those do not disappear because the weights have been modified.

This is also the first boundary of intellectual property. Kvantim may own its training pipeline, data curation, evaluations, product code and some resulting changes. That does not mean it owns every layer underneath them.

Clarity here is not a weakness. It is part of being deployable.

Retrieval changes the context, not necessarily the model

Retrieval-augmented generation, usually shortened to RAG, brings relevant material into the model's context when a request is made.

For example, a company can index its procedures and retrieve the most relevant passages for a question. The model can answer with fresher or more specific information without changing its weights.

RAG can be a strong solution. It can also fail through poor retrieval, missing sources, stale indexes or an answer that ignores the retrieved evidence. It should not be called model training when no training occurs.

Fine-tuning changes behaviour through examples

Supervised fine-tuning trains the model on examples of desired input and output. It can improve format, style, task behaviour or domain patterns. It does not automatically install a perfectly searchable database of facts.

Fine-tuning also raises questions about data quality and evaluation. A model can become better at the target behaviour while becoming worse somewhere else. The result needs a test set that was not simply copied from the training examples.

Adapter training changes a smaller part of the system

Parameter-efficient methods can train smaller additional weight sets or a limited subset of model parameters. They may be faster and less expensive than updating the full model.

That does not make them universally better. The right method depends on the target task, deployment constraints and how much behavioural change is needed. The key is to state which method is being used instead of hiding all of them under "reweighting".

Continued pre-training changes domain familiarity

Continued pre-training exposes a base model to more text through the same broad learning objective used during pre-training. It can deepen familiarity with a language, terminology or domain distribution.

It can also require substantial compute and carefully rights-cleared data. The evaluation has to show more than whether the training loss went down. The model must be tested on the actual capabilities and failure modes that matter to the intended deployment.

Memory is another separate mechanism

When a personal AI remembers a project or preference, that memory does not have to become a new model weight. It may live in a local memory system that retrieves relevant context later.

This distinction is one reason Kvantia AI and Kvantim LLM are separate Kvantim directions. Personal memory, a model-training programme and a supervision layer around AI work solve different problems even when users describe all three as "learning".

Evaluation is part of training, not a final marketing step

A training run is not complete because it produced a model file.

Before a model is called ready, the team should be able to answer:

  • What task or domain was the model trained for?
  • Which data were used, and under what rights?
  • Which tests were held out from training?
  • What is the baseline?
  • Which capability improved?
  • Which capability regressed?
  • What safety and privacy checks were run?
  • On which hardware, latency and cost was it measured?

The answer may reveal that retrieval is enough, that a smaller adapter is better, or that the base model should change. Evaluation is how training becomes an engineering decision rather than a branding exercise.

What Kvantim LLM will make explicit

As Kvantim LLM progresses, its technical material should publish:

  1. the open-source base model, version and licence;
  2. the Kvantim modifications;
  3. the training method for each release;
  4. the lawful data scope;
  5. the evaluation methodology and results;
  6. the deployment and commercial licence;
  7. what a partner can train, host, move or inspect.

Until those details are approved, the honest status is more useful than a broad claim. "In development" tells the truth. "Ready for training" is useful only if it explains what is ready: data, pipeline, architecture, hardware, team and evaluation plan.

Trainable AI should mean a defined change to a defined system, measured against a defined goal. Anything less is just a flexible word.

Discuss a Kvantim LLM pilot →

Kvantim LLMTechnology