Detection pipeline - 17 May 2026

Raw data to reviewable alerts

This page specifies the planned onboard data path from raw thermal frames through calibration, geotagging, candidate detection, operator review, and dataset export. None of this software has been built yet; it is the design the eventual implementation will be judged against.

Pipeline principles

Detection must be traceable to thermal source data, not display colour.

Raw first Preserve radiometric or pre-AGC thermal frames before any palette or display transform.
Calibrated Attach calibration state, detector settings, shutter events, and quality flags to every frame.
Mapped Carry timestamps, pose, altitude, speed, geotag quality, and footprint estimates into each alert.
Replayable Every alert, rejection, and validation score must link back to raw context and reviewer labels.

What changed

The concept has a data contract for flight software and validation work.

The pipeline separates thermal evidence from operator imagery. AGC colour video can help a person inspect a scene, but it is not the quantitative evidence path for detection or performance claims.

The output is a small alert packet for operators plus enough raw, calibrated, geotagged context to replay missed detections and false positives after the flight.

Stage map

Each onboard stage has a record that future validation can audit.

Stage Minimum function Record kept Failure gate
Raw capture Acquire radiometric or pre-AGC thermal frames at the selected detector bit depth and frame rate. Frame ID, detector branch, settings, NUC state, timestamp, dropped-frame count, checksum. AGC-only input can support viewing, but not a detection claim.
Calibration Apply detector correction, bad-pixel handling, reference-target correction, and later path corrections. Calibration version, reference reading, ambient and payload temperature, window state, flags. Stale calibration marks alerts as uncalibrated.
Geotagging Attach GPS/IMU time, pose, altitude, speed, and footprint estimates to each alert crop. UTC timestamp, monotonic clock, GPS quality, attitude, transform version, footprint. Invalid pose withholds precise map coordinates.
Detection Find compact thermal anomalies against local background using raw or radiometric values. Threshold profile, background estimate, extent, peak value, contrast, persistence count. RGB-only or palette-only candidates stay visual-review only.
Rejection Suppress common rural false positives using context, motion, morphology, history, and optional RGB context. Rejection features, assigned clutter class, local scene context, recent-frame history. Non-reproducible rejections remain in the review queue.
Alert Send a compact packet for operator review while keeping a replay link to raw context. Candidate ID, footprint, confidence band, crops, frame links, threshold and calibration provenance. Packets without raw or calibration references are not validation evidence.

Data products

The camera must save more than a picture of a hot spot.

Flight manifest

Platform, detector, optics profile, software versions, calibration files, route, weather fields, operator, and storage roots.

Frame index

Timestamp, raw checksum, calibration state, pose/geotag status, quality flags, and storage pointer for each frame.

Alert packet

Candidate geometry, confidence band, radiometric crop, context image, threshold provenance, geotag, and replay pointers.

Review log

Human label, notes, reviewer role, review time, final action, and links to raw and calibrated crops.

Dataset export

Source flights, split membership, checksums, labels, calibration state, detector assumptions, and metric configuration.

Replay outputs

Deterministic alert and rejection deltas when thresholds, calibration, or detection code changes after a flight.

Operational review

Ambiguous detections should be preserved for review, not hidden by a hard reject.

Rural false positives include sun-heated rocks, roads, roofs, metal gates, machinery, vehicles, people, livestock, smoke, dust, haze, water, residual heat, bad pixels, shutter transients, and window contamination.

The first onboard detector should be simple and auditable: calibrated thermal thresholds, local background estimates, compact connected components, temporal persistence where dwell permits, and written threshold state in every alert packet.

Learned classifiers can be added later only if they preserve the same raw-frame, calibration, geotag, alert, and review interfaces.