Industries · The Arts & Culture

The collection has to outlive the grant, the vendor and the file format.

Preservation is an operating commitment, not a purchase. The institutions that hold their collections well are the ones whose architecture assumed a twenty-five year horizon, a flat budget and staff turnover from the beginning. We design for that horizon, and we cost it out loud.

The constraint we design around first

A backup is not preservation. It is a copy of your current problem.

Backup protects against loss over days and weeks. Preservation protects against silent corruption, format obsolescence, media decay, vendor withdrawal and the departure of the only person who understood the folder structure. Different problems, different engineering.

What actually takes collections

Catastrophic loss is rare and memorable. Attrition is common and invisible, which is why it does well in budget negotiations. Each of the following is a failure mode documented repeatedly in preservation literature.

Bit rot
Silent corruption in a file nobody has opened since ingest. Without a stored checksum there is no way to know the file changed, and a backup rotation will faithfully propagate the damaged version.
Format obsolescence
A proprietary raw format whose only reader was discontinued. The bits are perfect and the image is unrecoverable without emulation or a migration that should have happened a decade earlier.
Media and system obsolescence
LTO written eighteen years ago, on a generation no current drive can read, in a container format that required software now unavailable. Tape is durable. Tape ecosystems are not.
Loss of context
Files survive, metadata does not. An untitled TIFF with no accession number, no capture record and no rights determination is data, not a collection item.
Vendor withdrawal
A digital asset management platform that sunsets, or a hosting contract that lapses. If the archival copies only exist inside a supplier's system, the collection depends on that supplier's commercial health.
Institutional forgetting
The digitisation officer leaves and takes the naming convention with them. Preservation that depends on a person, rather than on documented and automated process, has a known expiry date.

Every one of these is addressable with practice that is well established in the sector. None of them is addressed by buying more storage.

Diagram — OAIS functional model as implemented: ingest, archival storage, data management, preservation planning and access, 1200×900
We are the infrastructure, not the authority. Collection policy, appraisal, description and rights determinations belong to your curators, archivists and the communities whose material you hold. Our job is to build a system that carries out those decisions reliably and proves that it did.

Digital preservation

Six functions, each with a scheduled job behind it.

OAIS is a reference model, not a product, and that is its value: it separates the things a repository must do. Implemented properly, each function is something that runs on a schedule and produces evidence a board can read.

01

Ingest that refuses ambiguous material

Submission packages are validated on arrival: format identified and characterised, required metadata present, checksums generated and recorded, and a persistent identifier assigned. Material that fails validation is quarantined with a reason rather than accepted quietly. A repository that accepts anything is storing a future problem at archival cost.

02

Fixity checking on a schedule you can defend

SHA-256 checksums stored separately from the objects, verified on a rolling cycle sized so that every item is checked within a stated period, and every verification result logged whether it passed or failed. The point is not the hash. It is being able to say when a file was last known good, and to repair from another copy before the damaged version becomes the only version.

03

Copies that fail independently

Three copies, at least two storage technologies, at least one geographically separated and one logically isolated against ransomware and operator error. The discipline is in the word independent: three copies on one filesystem share a single failure, and object-storage versioning within one account shares a single credential.

04

Format policy and migration as normal operations

A written format register: what is accepted for preservation, what is tolerated, what is at risk. Uncompressed or lossless TIFF and JPEG 2000 for images, open container and codec choices for audiovisual material, PDF/A or plain text where documents allow. Migration is a planned event with the original retained, the transformation recorded, and a sample validated by a person.

05

Packaging that a stranger can open

BagIt-style packages with checksum manifests, and preservation metadata recorded in an open standard such as PREMIS, so provenance and every event acting on the object travel with it. The test we apply is blunt: could an archivist in 2050, with no access to your current systems and no phone number to call, understand what they are holding.

06

Restore rehearsals, not restore assumptions

A documented recovery exercise on a real sample, timed, at least annually, with the result reported. This is where paper compliance and actual capability separate, and it is the single most useful thing an institution can add to an existing arrangement. Plenty of repositories discover their tape drive generation problem during a rehearsal, which is the correct time to discover it.

SHA-256Default fixity algorithm, stored independently of the objects it describes
3 · 2 · 1Copies, storage technologies and offsite separation as the minimum design
AnnualMinimum cadence for a timed, documented restore rehearsal with a reported result

Large-scale digitisation

Capture once, to the standard you cannot afford to repeat.

Handling is the expensive and risky part of digitisation, and every item handled twice is a conservation cost as well as a budget one. The capture specification should be set against what the item will be asked to support in thirty years, not against this year's website.

Specification and conservation review

Resolution, bit depth, colour target and lighting agreed against a recognised imaging guideline, with conservation setting handling limits before any schedule is built. Output of this stage is a written capture specification and a throughput model, so the project plan is based on measured handling time rather than an optimistic item count.

Capture, including objects and structures

Flat material on calibrated copy stands and scanners with colour targets in frame. Three-dimensional objects by photogrammetry or structured-light and laser scanning, where the deliverable is a dense mesh with measured scale and a documented capture geometry, not just an attractive render. For large objects and sites, terrestrial laser scanning and drone photogrammetry produce point clouds that need real processing capacity behind them.

Processing capacity sized to the queue

Photogrammetric alignment and mesh reconstruction are GPU and memory bound, and a single high-resolution object can occupy a workstation for hours. On a programme digitising thousands of objects, that queue determines the whole schedule. We size a small cluster or a burst arrangement against the capture rate, so processing never becomes the reason the imaging team stops.

Derivatives generated, never hand-made

The preservation master is untouched. Access copies, IIIF tiles, thumbnails, web video and 3D viewer formats are all generated from it by a recorded pipeline, so they can be regenerated when standards change or a viewer is replaced. Manually produced derivatives become a second collection that nobody can reproduce.

Quality assurance by sampling, with authority to stop

Statistical sampling against the capture specification, checking focus, colour accuracy, completeness and metadata linkage, with a named person authorised to halt a batch. Discovering a lighting drift after forty thousand items is the failure this stage exists to prevent.

Automated description has a place, and limits. Machine transcription, optical character recognition and similarity search make a collection far more findable, and they should be used. The output is a research aid attributed to a model and a version, held separately from curatorial description, and never presented to the public as authoritative catalogue metadata.

Metadata and discovery

An item nobody can find has been stored, not published.

Discovery infrastructure is where a preservation programme earns its funding back. It is also where open standards pay off most obviously, because they let you change your viewer, your website and your aggregator without touching the collection.

IIIF for images and audiovisual material

The Image and Presentation APIs decouple your collection from any particular viewer. A manifest describes the object, tiles are served on demand, and researchers can compare items held in different institutions in one workspace. Practically, it means a deep-zoom viewer becomes a configuration choice rather than a redevelopment project, and authentication can gate restricted material at the API rather than in the interface.

Description that travels

Dublin Core as the interoperable floor, with richer sector schemas — archival, museum or audiovisual — where your material needs them, and controlled vocabularies for people, places and subjects. Mapping between them is designed once and applied by the pipeline, so an aggregator harvest does not become an annual manual export.

Linked open data, where it earns its keep

Publishing identifiers rather than strings lets your holdings connect to other collections and to external authority records. It is genuine work and it repays itself on named entities and places. We will say plainly when a linked data programme is being proposed for its own sake, because a poorly maintained triple store is worse for discovery than a well-kept catalogue.

Persistent identifiers and collection system integration

ARKs, DOIs or handles so a citation made today still resolves after two website rebuilds. Your collection management system stays the single source of curatorial truth, with a defined synchronisation path to the repository and the public site, so nobody maintains the same record in three places and no system quietly becomes the accidental master.

Choose the standard that lets you replace us. If your collection only works through one supplier's software, the preservation plan has a commercial dependency in it.
Cloud Natives Collections and preservation practice

Interactive and immersive installations

It has to run for eight months with a cleaner as the only operator.

An exhibition build is judged on opening night and lived with for a season. The engineering that matters is what happens on day ninety, when the artist has moved on, the developer's contract has ended and a projector lamp is dimming.

Designed to fail visibly and recover alone

The worst failure mode in a gallery is the silent one: a screen showing a plausible but frozen image for two days. Everything we build declares its own health, and recovers without a person where it safely can.

  • Watchdog processes and hardware watchdogs that restart a stalled application, with every restart logged and counted rather than hidden
  • Scheduled power-on and shutdown tied to opening hours, because thermal cycling and lamp hours are the consumables that decide the season's budget
  • A monitoring feed a front-of-house supervisor can read, with a physical indicator in the space and an alert that names the artwork, not a hostname
  • Configured, tested spare machines on site, imaged identically, so a swap is a cable change rather than a rebuild
  • Acoustic and thermal design for a public room — a gallery that can hear the render node has a problem the visitor experiences directly
  • A handover runbook written for a technician who has never met us, with photographs, a wiring diagram and the three faults most likely to occur

The realtime layer

Unreal, Unity, TouchDesigner and Notch all work. The choice follows who will maintain the piece after handover and whether the source will still build in five years. Multi-projector installations need genlock and calibrated warp and blend, held as data so a bumped projector is a recalibration rather than a re-authoring. For sensor-driven work we set a frame budget and hold to it, because a piece that responds late reads as broken even at a high frame rate.

Diagram — unattended installation topology: render nodes, projectors, sensors, monitoring and the spare-swap path, 1200×900
Budget the season, not the build. An installation contract that covers only delivery leaves the institution carrying eight months of operational risk it did not price. We quote the exhibition period as a line item: monitoring, consumables, a service visit cadence and a defined response time. It is usually a small fraction of the build and it is the part that protects the visitor experience.

Access, rights and cultural authority

Open by default is a policy position, not a technical one.

A great deal of material held in Australian collections carries obligations that copyright law does not describe. Infrastructure has to be able to express those obligations precisely, change them when a community's determination changes, and prove what was accessible when.

01

Indigenous Cultural and Intellectual Property

ICIP rights sit with the communities and knowledge holders concerned, not with the institution that holds the physical item and not with us. Practically this means the repository must support restrictions that are specific rather than binary: access by community, by gender, by kinship relationship, by place, or only with a named person's permission. Systems that only offer public or private force custodians into a choice they should not have to make.

02

CARE alongside FAIR

The FAIR principles make data findable and reusable. The CARE principles for Indigenous data governance address what FAIR does not: collective benefit, authority to control, responsibility and ethics. In architecture terms, authority to control means the determination is recorded as data owned by the community and changeable by them, with a workflow for that change, rather than a note in a field that only staff can edit.

03

Labels, notices and the right to be told

Traditional Knowledge and Biocultural Labels and notices travel with the item and with its derivatives, including through IIIF manifests and aggregator harvests. If a record can be harvested without its conditions of use, the system has exported the object and dropped the obligation.

04

Withdrawal that actually withdraws

When a determination changes, material has to come down from the public site, the search index, the cache, the tile store, the aggregator and any derivative built from it — while the preservation copy is retained under restriction unless destruction is specifically directed. We design this path deliberately and test it, because in most systems it has never been exercised.

05

Restricted collections and audit

Sensitive material — sacred and secret content, records concerning individuals, closed archives and donor-restricted deposits — needs access decisions recorded with who approved them, on what basis and for how long. An access log that can answer a community's question about who saw their material is part of being trustworthy, not an afterthought.

Granular, community-changeable access rules CARE principles reflected in the data model Withdrawal path designed and tested Access decisions logged and reportable
How we prefer to work. On projects involving First Nations collections, we ask that community representatives and the institution's own cultural advisers set the access model before we design against it, and that our scope is written to serve that model. Where an engagement has not made room for that process, we will say so rather than build something that presumes an answer.

Cost modelling on a long horizon

A three-year quote for a twenty-five year obligation is a deferral, not a price.

Digitisation is usually funded as a project and preservation is always an operating cost. That mismatch is how collections end up on unpaid storage. The model has to name the recurring lines and the events that fall outside the funding cycle.

Indicative twenty-five year cost lines — replace with figures from your own preservation plan
Cost line Typical interval Usually missing from a three-year model
Storage capacity growth Continuous, compounding with each digitisation programme The second and third copies, and the growth rate rather than today's volume
Hardware refresh Roughly every five to seven years per generation Three or four refresh events across the horizon, each a capital request
Tape generation migration Every two to three LTO generations if tape is in the mix Drive compatibility windows, and the labour of rewriting the whole holding
Format migration events Unpredictable, plan for several Processing capacity, validation effort and curatorial sign-off time
Fixity and integrity operations Continuous background load Read bandwidth, egress on cloud-held copies, and someone to act on failures
Retrieval and restore On demand, rising with access success Egress and archival retrieval fees, which scale with popularity
Staff time Continuous The largest line in most honest models, and the first one omitted
Exit and migration provision Once, whenever a supplier or platform changes The cost of getting everything out, which should be quantified before signing

Design choices that lower the long-run number

Some decisions are nearly free at the start and compound in your favour for decades. Open, well-documented formats mean fewer forced migrations. Storing checksums and preservation metadata inside the package means a future migration does not require your current database. Keeping derivatives reproducible means you store one authoritative copy instead of five you dare not delete.

Where cloud helps and where it quietly does not

Object storage with versioning and object lock is a strong second copy, and cheap archival tiers are genuinely cheap to hold. The lines to model carefully are retrieval fees, egress if you ever move, and the minimum storage duration on cold tiers. A collection that becomes popular can turn a modest storage line into an unbudgeted retrieval line, and that is a success failing for the wrong reason.

Chart — twenty-five year cumulative cost by line, with refresh and migration events marked against the funding cycle, 1200×900
What we hand over. An editable model with the assumptions visible, a preservation plan mapped to OAIS functions, the format register, the fixity and rehearsal schedule, and a costed exit path. Those documents are useful to your board and to your next funding application whether or not we operate the platform.

Let's Talk

Tell us the collection, the obligations and the operating budget. We will model the twenty-five years.

A holdings inventory, your current storage arrangement and a candid figure for recurring funding are enough for a first assessment. If your existing setup is sound and only needs fixity checking and a rehearsed restore, that is what we will recommend.

Galleries, libraries, archives and museums
hello@cloudnatives.example
Direct line
+61 0 0000 0000
Grant timelines
Tell us the funding round and its deadline. It changes how we scope the first stage

Sydney · Melbourne · Canberra. Australian owned, Australian staffed.