MiKaDo

MiKaDo

Material integration of Knowledge and Digital observation

A conceptual model for situated observation in heritage science. It binds plural gazes to a material referent, in space and through time.

Purpose

Heritage knowledge is produced by people who look, measure and interpret while they record. The archaeologist drawing a section, the conservator marking an alteration and the conservation scientist choosing a sampling point bind observation, description and analytical intent in one gesture. Geometry of the object is routinely preserved; the conditions under which an observation was formulated — who acted, with which instrument, toward which question, on which region of the surface — stay queryable when the vocabulary keeps that passage.

MiKaDo is a model of mediation. Knowledge about heritage, in field and laboratory campaigns, is produced through situated, instrumented acts of observation. The role of the vocabulary is to articulate the passage from a material referent to shareable knowledge through those acts. Four corollaries follow. Knowledge is produced: every knowledge node is the outcome of an activity. It is situated: anchored to a place and to a time. It depends on an act: the walk from raw media to a statement always passes through an observed feature. It is plural: the same material referent admits several parallel programmes, which federation consolidates as plural.

Four domains carry that commitment. Material is the stable referent — artefact, building, site. Observations attach to a digital surrogate at any pixel; structure accumulates from gestures. Digital is what the act produces or invokes — frames, annotation shapes, recordings, session clouds. Those files sit beside the vocabulary, in one package, with the same identifiers as the graph. Knowledge is what is asserted — titles, measures, template fields, vocabulary. Activity is the hinge of the model: it binds the other three. In situ and ex situ qualify the mode of the gesture.

Two symmetric pivots gather the facts. ObservedFeature is a fact documented from the world by an instrumented human act. DerivedFeature is a fact computed from the resulting graph. They recompose in one RDF graph, so a title, a measure or a contour walks back to the gesture that produced it. The OWL 2 vocabulary is multi-typed to PROV-O, CIDOC CRM, schema.org, SKOS and SOSA/SSN, with published bridges, so the same export is readable in those ecosystems.

How activity is situated at three scales

Activity declines into three documentary scales: macro — the programme, the campaign; meso — the session, a field or desk window, with a trajectory and shared resources; micro — the act, the punctual gesture (a frame, a region, a measure, a dictation). Who, why, what, when, where, how and with what qualify that activity at each grain. At macro they are reified as documentation nodes; What and Where are shared with the material referent. At meso they live as a time window, a trajectory or a scene. At micro they are literals on the gesture itself. The same seven questions therefore run through the three scales; the material referent stays one entity.

Time runs through those scales. When qualifies the campaign, the session window and the punctual act. Several meso-sessions sit in one GraphSnapshot. Several agents can annotate one surrogate; the graph keeps each trajectory.

How a graph is produced

dür.air, a mobile digital fieldbook for persistent augmented reality, instantiates the TBox. Minutes of annotation on a tablet yield one spatial and semantic graph, exported as JSON-LD and Turtle with a GraphSnapshot envelope. Each gesture becomes a micro-activity, an observed feature, the media it weaves, the knowledge it states, and — when a deterministic method applies — one or more derived features. Other engines attach at the published pivots. The files those pivots point at — frames, shapes, recordings, clouds — are specified as Folio, the package companion to this model. The Viewer reads that package in the browser.

Similarity buckets are how the graph rises in grain over named subgraphs. An institutional node projects each observation onto four orthogonal axes — spatial, morphology, appearance, semantic — and writes a bucket node when at least two observations fall in the same slot.

The same second pivot also reads a named activity. A StatisticalProfile summarises a programme or a session. A CoverageMatrix records which of the seven documentary axes the campaign filled. A ComparativeReport sets two GraphSnapshots side by side — two objects, two visits, two institutions. That is the collection grain. The public exports already carry those nodes.

How a field graph is read

The same triples support three readings — the names the dür.air viewer offers as stacked filters. Documentary is the activity at three grains: the material referent, the programme and its W7 sheet, the sessions, the acts. Operatory starts from each micro-act: the ObservedFeature it produces, the digital traces, the knowledge it states. Reflexive starts from DerivedFeature: computed families, syntheses on a session or a programme, SKOS structures. They are developed in the model. The Viewer uses the same readings to pass from a node in the graph to the annotation in the scene.

An example field graph

Collaborative sculpture survey at the LRMH (10 September 2026): several observers annotate the same frames; the graph keeps each trajectory. Graph, scene and timeline stay linked — the same join the Viewer specifies for a Folio. Play starts the sequence; Subjective follows the event, Fit the whole view.

LRMH · collaborative annotation Open full screen

Several further field graphs are on the Examples page.

The citable core

The published TBox is mikado.ttl (mko:) — also on the download page, with shapes and bridges. dür.air produces the graphs. The package that holds the frames, shapes and clouds those graphs cite is Folio. The Viewer is the web reader of that package. quasi.modo is designed to consolidate them across institutional nodes, keeping media and vocabularies locally, through the shared TBox, the W7 grammar and SKOS closure.

Model, Folio, Viewer

Three parts of one observation. The model names it. Folio is the package a producer writes: the files, the poses, the annotations, and the graph. The Viewer opens that package in the browser. A geometric layer can carry both the file to archive and process again, and the declination the browser streams. The source stays in the package. The rendition is what appears.

Activity is the hinge of the model: it binds material, digital and knowledge. The photograph is the hinge of the package: a generic sensor record, the interface of an in situ acquisition, of an ex situ reconstruction, and of any 2D viewpoint in a 3D scene. A stroke, a measure and a voice note are drawn on that image, and the pose carries them onto whatever geometry is loaded. The two hinges are two joints of the same gesture.

The same thing Model Folio Viewer
Material referent MaterialEntity Named by the project. The object stays outside the package Project panel
Programme MacroActivity One package, core/project.json The whole scene
Session MesoActivity One entry of core/sessions.json The session filter
Act MicroActivity One annotation — graphic, metric or voice That graphic, metric or voice annotation
Photograph DigitalEntity, a frame Oriented photograph, pose and intrinsics The camera and the gallery
What someone states KnowledgeEntity Title, template fields, SKOS concepts The detail of the annotation
What is computed DerivedFeature Morphology and appearance The same detail
Point cloud, mesh, gaussian DigitalEntity The source — E57, OBJ, a gaussian PLY, or another accepted host — and, when published, its web rendition Streams that rendition: Potree, Nexus, Spark SPZ

The same identifier string runs through the three columns. It is the segment of the IRI, the file name in the package, and the annotation the Viewer selects.

The frame named viewer-z-up is the coordinate system the scene is drawn in. The MiKaDo Viewer is the application that reads a Folio. The dür.air viewer is the field application already running: it reads the bundle dür.air projects, and it draws in that same frame. Documentary, operatory and reflexive are filters of the graph. A geometric layer is the point cloud, the mesh or the gaussian.

Credits

MiKaDo — the model, Folio and the Viewer — is authored by Livio De Luca, Anthony Pamart and Quentin Vogel at the CNRS MAP laboratory (UPR 2002), with principal support from the ERC project n-Dame_Heritage (ERC-2021-Advanced Grant, No. 101055423), and complementary support from the European project GRAPHIA (HORIZON-INFRA-2024-TECH-01, No. 101188018) and the E-RIHS infrastructure (ERIC, European Research Infrastructure for Heritage Science).